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Preface 


The present volume of The Pocket Mathematical Library 
continues the study of infinite series begun in its companion 
volume Infinite Series: Rudiments, by the same author. Together 
the two volumes give a detailed treatment of the theory of nu- 
merical series, i.¢., infinite series whose terms are numbers. The 
picture is then completed by a third volume, entitled Functional 
Series, which, as its name implies, is devoted to the study of 
infinite series whose terms are functions. The set of three vol- 
umes makes up a comprehensive treatise on all aspects of a key 
topic of pure and applied mathematics. 

As in the companion volume, the problems appearing at the 
end of each section constitute an important part of the course, 
and should not be neglected by the serious student. 
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CHAPTER 1 


Operations on Series 


1. Associativity of Convergent Series 


The concept of the sum of an infinite series differs substan- 
tially from the concept of the sum of a finite number of terms 
(considered in arithmetic and algebra) in that it involves taking 
a limit. In certain cases, properties of ordinary sums carry over to 
sums of infinite series, but usually only under certain conditions 
to be determined below. In other cases, the ordinary properties 
of finite series break down in a striking fashion. Thus, in general, 
we must be very careful when attempting to extend properties of 
finite sums to the case of infinite series. 

Our first result along these lines expresses the associativity of 
convergent series, analogous to the similar property of finite 
sums: 

THEOREM 1. Let 


Q,+ a, ++ +a, +-" (1) 
be a convergent series, and let* 
Qt G,¢--+& t+ = (a, ++ +4,) 
+ (Gaya tort t+ nz) to + Gay pea tot + ny) + oo 
(1) 


1, Here {1,} is some subsequence of the sequence of positive integers 1, 
2,... Such that 1) < mg <"«'. 
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be a new series obtained from (1) by amalgamating the terms of (1) 
in arbitrary groups without changing the order of appearance of 


the terms. Then (1) is convergent, with the same sum as (1). 
Proof. The sequence of partial sums 


Ay = G, + Gg to + & 
= (ay +) + Qn.) + (Qny41 Hot + Gy) + 
+ (Qn, 41 4 ott + Gn,) (k = 1, 2,...) 
of the new series (1) is just the subsequence 
Anys Ange «+3 Anya «+ 
of the sequence of partial sums 
A, = @, ++ + a, (n = 1,2,...) 


of the original series (1). But obviously every subsequence of a 
convergent sequence with limit A (say) is also convergent with 
limit A. IP 

Unlike the case of finite sums, the associativity of convergent 
series breaks down if we try to apply the property in reverse 
order, so to speak. More exactly, suppose we start from a con- 


vergent series of the form (1). Then the new series (1) obtained 


by dropping parentheses in (1) may well turn out to be diver- 
gent. For example, the two series 


d-i)+d-H)+d-1++-=04+0+0--=0 () 
and 

1-d-l-d-)--+-=1-0-0--::-=1 (@) 
both converge, but the series 


l-l+1—-1l+1l—-14- 


2. The symbol | stands for Q.E.D. and indicates the end of a proof. 
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obtained by dropping parentheses in either (2) or (3) obviously 
diverges. However, Theorem | has the following qualified con- 
verse: 

THEOREM 2. Given a convergent series(1), suppose the series (1) 
obtained by dropping parentheses in (i) is convergent. Then its sum 
is the same as the sum of the original series (1). 

Proof. An obvious consequence of Theorem 1. 

Under certain conditions, convergence of (1) does in fact 
guarantee that of (1): 

THEOREM 3. Suppose the numbers inside each set of parentheses 
in the series (1) all have the same sign, where this sign may vary 
from one set of parentheses to the next, and suppose (1) is conver- 
gent. Then the series (1) obtained by dropping parentheses in (i) is 
also convergent. 

Proof. In this case, the partial sum A, either increases or de- 
creases as n increases from n,_, to n,. Therefore 


An; < A, < An, or An. 2 Ay = Ans 
where n = mg_1,.--, Mg. Equivalently, 
A,-3 < An < A, or Ax-4 2 An 2 An, (4) 


for the same values of n. But A, > 4as k > «0, where A is the 


sum of (1) and hence, by (4), 4, 7 dasn7 0. I 
Example. Prove the convergence of the serics 


=v 
oe ” 


where [x] is the integral part of x, i.e., the largest integer <x. 
Solution. Grouping together terms of identical sign in (5), we 


_ 1 1 1 
y (=1)* | — + —— 4+ + ——__ 
ke k? k? 4+] (K+ 1)? - 1 


=> (“Ik ex. (6) 


(5) 
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k terms 
a LN 
2 1 1 1 
<— + —— 4 + 
2k+1 k? k? +1 ke+k-—-1 
k+1 terms 
1 1 


2 
Rok (k +13? — 1 k 
since each of the first k terms lies in the interval 


| <x<et 
eek k? 


while each of the last kK + 1 terms lies in the interval 


—! exe l . 
(k + 1)? ke? +k 


Therefore {c,} is a decreasing sequence with limit zero. It follows 
from Leibniz’s test (Ruds., p. 73)> that (6) converges. But then 
(5) also converges, by Theorem 3. 


PROBLEM 
Prove that if 
1 1 1 
=] -—- — —_— — — : 
P 2s 35 4s 
peta tg byt 
2s 35 4s , 


then 


p=(t- wr) (7 


ifs > 1. Prove that (7) leads to an absurdity if0 < s < 1. Why? 


3. The abbreviation Ruds. refers to the volume Infinite Series: Rudiments 
by G.M.Fichtenholz (The Pocket Mathematical Library). 
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2. Commutativity of Absolutely Convergent Series 


Let 
Q,; + ag+:": + Qn to (1) 


be a convergent series, and let 
ay + a3 feovee a + = an, + an, foe an, + oe (1’) 


be a new series obtained from (1) by rearranging its terms in any 
way whatsoever.* We then ask whether the series (1’) converges, 
and if so, whether it has the same sum as the original series (1). 
There is now a sharp distinction between the case of absolutely 
convergent series and that of conditionally convergent series. In 
fact, absolutely convergent series, as opposed to conditionally 
convergent series (see Sec. 3), are commutative in the sense of the 
following 

THEOREM. Given an absolutely convergent series (1), the series 
(1’) obtained by arbitrarily rearranging the terms of (1) is conver- 
gent, with the same sum as (1). 

Proof. First suppose the series (1) is positive. Given any posi- 
tive integer k, let N be the largest of the integers n,, m2, ..., Mx. 
Then, obviously, 

Ay < Ay, 


where Ay is the Nth partial sum of (1) and A; the Ath partial sum 
of (1’). Hence, a fortiori, 
A, <A, 
where A is the sum of (1). It follows that (1’) is convergent 
(why?), with sum J’ satisfying the inequality 
A’ <A. (2) 
4. Thus {,} is a sequence made up of all the positive integers 1, 2, ... 


(without omissions or duplications), but no longer arranged in increasing 
order. 
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On the other hand, the series (1) can also be regarded as a re- 
arrangement of the terms of (1’), and hence 


A<A’, (3) 
by exactly the same argument. Comparing (2) and (3), we get 
A'=A, 


Now suppose (1) is an arbitrary series, whose terms can have 
values of either sign. The series 


Y lanl = lay) + lag ++ + ag] + (4) 
na=i1 


converges, since (1) is absolutely convergent, and moreover, any 
rearrangement of (4) also converges, since (4) is a positive series. 
Therefore (1’) is also absolutely convergent, with sum A’. But 
the sum A of the absolutely convergent series (1) can be written 
in the form 

A=P-— Q, 


where P and @Q are the sums of the positive series 


Ln (5) 


and 
Xu qk (6) 


formed from the positive terms p,, D2, ... of (1) and the absolute 
values q,, 42, --. of the negative terms (Ruds., p. 64).5 Rearrang- 
ing the terms of (1) induces corresponding rearrangements of the 
terms of (5) and (6), but as shown in the first part of the proof, 
this has no effect on the sums P and Q of these series. It follows 


that 
A’=P-Q=A. Bi 


5. The terms of (5) and (6) are arranged in the same order as they (or 
their negatives) appear in (1). 


Operations on Series 7 
PROBLEMS 


]. Prove that the factors of an absolutely convergent infinite 
product (Ruds., p.97) can be rearranged arbitrarily without 
affecting either the convergence or the value of the product. How 
does this apply to the product 


(Ruds., p. 132)? 


2. Verify the expansion 


Prove that the factors on the right cannot be arbitrarily re- 
arranged. 
Hint. The series 


is conditionally convergent, and hence its terms cannot be 
arbitrarily rearranged (see Sec. 3). 


3. Verify the expansion 


sinx =x i (1 _ =) ei (: + =) ent 
no nz 


Prove that the factors on the right can be arbitrarily rearranged. 
Hint. The infinite product is now absolutely convergent (why?) 


3. Riemann’s Theorem 


Next we show that a conditionally convergent series does not 
have the commutative property, and in fact can be made to have 


a different sum or even to diverge by suitably rearranging its 
terms, 
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Lemma. Let 


Q, + a, + +a, te (1) 
be a conditionally convergent series, let 


Prt Pa bor + py te (2) 


be the series formed from the positive terms of (1), and let 


Wat date tat (3) 


be the series formed from the absolute values of the negative terms 
of (1).© Then the series (2) and (3) both diverge. 

Proof. Let the series (1), (2) and (3) have partial sums A,, P, 
and Q,, respectively. Then 


A, = P; ~~ Q;, (4) 
and 
An = P; + Qy, (5) 


where A,* is the nth partial sum of the series 
la,| + la2| + +++ + lal ++, (5*) 


and jis the number of positive terms and & the number of nega- 
tive terms in the first n terms of (1). If one of the series (2) and (3) 
converges, then so does the other, because of (4). But then the 
series (5*) converges, because of (5), i.e., (1) is absolutely con- 
vergent, contrary to hypothesis. This contradiction shows that 
(2) and (3) both diverge. [ff 

Remark. Despite the fact that (2) and (3) both diverge, we have 


lim p; = jim gq. = 9, (6) 


jinn 


6. Footnote 5 also applies here. 
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since (1) converges (conditionally) and hence 


lim a, = 0. 
Awn 

We can now prove the following remarkable 

THEOREM (Riemann’s theorem). Jf the series (1) is conditionally 
convergent, then, given any number B (finite or equal to + «), the 
terms of (1) can be rearranged to give a new series whose sums 
equals B. 

Proof. First suppose B is finite. Since the series (2) and (3) 
both diverge, the same is true of all their remainders (Ruds., 
Theorem I, p. 6). Hence, starting from any position in the series 
(2) and (3), we can choose enough terms to make the sum exceed 
any given number. Using this fact, we now arrange the terms of 
the series (1) as follows. First we choose enough positive terms 
of (1), in their order of appearance in the series. to have a sum 
greater than B: 


Pit Pato + py, > B. 


We then write down enough negative terms (again in their order 
of appearance in the series) to make the resulting sum Jess 
than B: 


Prt Porter t+ Py -— G1 — 92-0 — Iy < B. 


Next we add more positive terms (from those that remain) to 
have 


Prt + Py Gy mt > Fy + Pag toe + py, > B. 


Then we choose enough negative terms (from those that remain) 
to have 


Prt + py NM — oe — QU, 


+ Pita tot + Pkg — Uae Tt ky < B, 
I Fichtenholz (2094) 
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and so on. Obviously, every term in the original series will 
eventually appear in the new series if this process is continued 
indefinitely. 

Now suppose that every time we write down groups of positive 
and negative terms, we see to it that no more terms are added 
than needed to make the sum greater than or less than B, as the 
case may be. Then the deviation of this sum from B (on one side 
or the other) can never have an absolute value greater than the 
last term written down. Therefore it follows from (6) that the 
new series 


(ate ty) — Gi to +) 
+ (Py pga toe + Pa) + Geta tot + Mey) to (7) 


is convergent, with sum &. Hence, by Theorem 3, p. 3, the sum 
of (7) after dropping parentheses is still B. 

Finally suppose B = +00. Choosing an increasing sequence 
of numbers B, , B,,... approaching infinity, we first select enough 
positive terms to exceed B,, afterwards adding one negative 
term, then select enough positive terms to exceed B,, afterwards 
adding another negative term, and so on. This obviously gives a 
series with sum +00. Similarly, we can find a rearrangement of 
the series (1) with sum —coo. § 

Remark. Riemann’s theorem makes it clear that conditional 
convergence of a series comes about only because of mutual 
cancellation of positive and negative terms, and hence depends in 
an essential way on the order of appearance of the terms. On the 
other hand, absolute convergence of a series comes about 
because of the rate at which the terms grow small, and does not 
depend on the order in which the terms appear. 

Example. Consider the conditionally convergent series 


1 
foe po 


_ 1 
4 2k — 1 2k 


1 1 
—+—-— 
2 3 
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with sum In 2 (Ruds., p. 117). Rearranging the terms in such a 
way that two negative terms follow each positive term, we get 


a (9) 
As we now show, the effect of this rearrangement is to make the 


sum of (8) one half as small. In fact, denoting the partial sums 
of (8) and (9) by A, and A,, respectively, we have 


” ] 1 1 
Asm = — ——— - — 
> Les 4k — 2 x) 


m 1 1 
-L (gc we) 


2 K=1\2k — 1 2k 
and hence 43, -> 41n 2. But 
, , ] , , ] 
A3m—-1 = Asm + tm’ A3gm-2 = Agm—1 + 4m 2 


approach the same limit 1n 2. Therefore the series (10) is con- 
vergent, with sum 4} In 2. 


PROBLEMS 


I, Given a conditionally convergent series and any two num- 
bers Band C > B, prove that the terms of (1) can be rearranged 
in such a way that the partial sums of the series have B as 
their smallest limit point (lower limit) and C as their largest 
limit point (upper limit). 


2. Starting from the formula 


Halt te tim innt CH y% 
n 
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for the nth partial sum of the harmonic series (Ruds., p. 18), 
where C is Euler’s constant and y, — 0 as n — o, prove that 


pterms qa terms 
| GVvK—cm—_—_———_——, 
I I I I 
1+ — fee +t i Se pe 
3 2p — 1 2 2q 
p terms 
{ss eo 
I I 
+ fot 
2p +1 4p —1 
qa terms 
—_—_——ee —~. 
1 ~ = ey nel), 
2q + 2 4q q 


where the series on the left is a rearrangement of the condition- 
ally convergent series (8). In particular, verify that (8) and (9) 


have the sums In 2 and i In 2, as in the above example, and 
show that 2 


Is this kind of rearrangement sufficiently general to give a series 
with any preassigned sum whatsoever? 
Hint. Note that 


1 1 1 1 1 1 1 
—4+—4:++4 —=—H, = —Inn+—C+ —y,, 
2 4 2n 2 2 2 2 
1 1 1 
P+otet —=H,—-—H, 
3 2n — 1 2 
=In2+—lInn 
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4, Multiplication of Series 


We have already considered term-by-term addition (or sub- 
traction) of two convergent series, as well as multiplication of 
a convergent series by a constant (Ruds., p. 7). We now consider 
multiplication of two convergent series 


A= ¥V Gy = a, + a, + + ay + (1) 

m=1 

and ~ 
B=) b=b; + bg +++ +b, t-. (2) 

n=1 


Guided by the rule for multiplying finite sums, we now consider 
all products of the form a,b,, arranged in an infinite ‘‘rectangu- 
lar’? matrix 


a,b, ab, a3b, nee a,b, ute 
a,b, a,b, a3b, nee ab, ose 


a,b; ab, a3b, vee ab; one 


(3) 


a,b, ad, a3b, see a,b, os 


There are many ways of arranging these products in a sequence. 
For example, we can enumerate products “by diagonals”, 
indicated schematically by 


Ff «+ 
ab; ab, a3b, -- 
rn Aa Aa 
a,b, azb, a3b, 
4 4 f « (4) 
a,b, a,b; a3b3-- 
“ 4 7 
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or “‘by squares,”’ indicated by 


a,b,| arb, a3b,|+- 


a,b, a,b, a3b, use 
a,b; ab; a3b3 sre (3) 


This gives the sequences 


Q1b,, a,b2, Azb,, a1b3, dbz, a3by, ... (4) 
and 


ta 
@1b,, a,;b,, Q2b2, Ab, , a,b3, A2b3, a3b3, a3b2, a3by, ..., (5’) 


respectively. A series formed from a sequence like (4’) or (5’) is 
called a product of the series (1) and (2). Every such product has 
the same value if (1) and (2) are absolutely convergent, as shown 
by the following 

THEOREM (Cauchy’s theorem). Jf two series (1) and (2) are 
absolutely convergent, with sums A and B, then their product, 
formed from the numbers (3) taken in any order, is also absolutely 
convergent, with sum AB. 

Proof. By hypothesis, the series 


Y l@ml = laa] + laa] + ++ + lanl + + (1*) 
m=1 

and 

d [b,| = [by] + lb2l + + + [By] +o (2*) 


both converge, i.e., have finite sums A* and B*, say. Making an 
arbitrary arrangement of the products (3), we get a series 


Mes 


a; by, = a;,Dx, + a,b, tore + a; by, 5 (6) 


s=1 


To prove the absolute convergence of the series (6), we estimate 
its partial sums. Let N be the largest of the integers j,, k,,j2, 
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ka, -+-9ds, Ks. Then obviously 
|a;,5x,| + 1a;,bx,1 + -*- + 1a,5e,| 
< (la| + [a2] + --- + layl) (Bil + [2] + «+ + [byl 
< A*B*. (7) 
Since (7) holds for all s, the series (6) converges absolutely, as 
asserted. 

To determine the sum of (6), we rely on the absolute con- 
vergence of the series and Riemann’s theorem to arrange the 
terms of (6) more conveniently. Enumerating these terms “by 
squares,” as in (5), we amalgamate the groups of terms by which 
consecutive squares differ from each other, obtaining 
a,b, + (a,b + dab, + ayby) 

+ (a,b, + azb, + a3b3 + a,b, + a3b,) + wre (8) 
Then, letting A,, and B, denote the partial sums of (1) and (2), 
we find that (8) has partial sums 

A,B, = ab, 
A,B, = (a; + 42) (b; + bz) 
A3By = (a; + a2 + a3) (b; + bz + bs), 


which clearly converge to the product AB. But AB is the sum of 
(6), as well as of (8). I 

Remark. In actually carrying out multiplication of series, it is 
usually best to arrange the products (3) “by diagonals,” as in (4), 
and then amalgamate terms lying on each diagonal: 


AB = a,b, + (a,b, + aby) + (@yb3 + aby + a3b1) +. 
(9) 


This is the form in which Cauchy first represented the product of 
two series. Therefore (9) will henceforth be called the product of 
the series (1) and (2) in Cauchy’s form. 
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Example, Using (9) to multiply two power series 


YY, A_X™ = Ag + AX + Agx? + + A_X™ Ho, 
m=0 
(10) 
S, bx" = bo + byx + bgx* + + Bx + 
n=0 


(where x lies within the intervals of convergence of both series), 
we find that 


wm oa 
Y anx™ Y b,x" 
n=0 


m=0 
= Abo + (Goby + abo) X + (@obz + ayby + agbo) x? +. 
(11) 
Thus the product of two power series in Cauchy’s form is 
automatically represented in the form of a new power series. The 


process leading from (10) to (11) is often described as “‘term-by- 
term multiplication” (in accordance with Cauchy’s rule). 


PROBLEMS 


1. By multiplying the series 


1] Lee) 
= SV xe=1Li xt x?tertxmee lx] < 1) 
1-x n=0 


by itself, prove that 


] x. 
———— = 9 mx" 2 = 14 2x4 3x? +--+ mx 1 ee 
ad _ x)? n=1 


(|x| < 1). 
2. By multiplying the series 
1] wo 
= ¥ (-1yt x = 1 — x 4 x? — et (- 1) x 4 
14+x m=0 


(Ix| < 1) 
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by the series 


In(1 + x) = yy 


2 3 
ay yp HL (er SB 4... 
2 3 n 
(Ixl < 1) 
(Ruds., p. 117), prove that 
nd +) _ y (1p Hat =x ry x2 foe 
1+x n=1 2 


1 1 
+ or(t to ten + ae toe 
2 n 


(Ix| < 1), 
where H, is the nth partial sum of the harmonic series. 


3. Use term-by-term multiplication to prove the identity 


Y A,X" = 
n=0 


io] 


a,x" 
1 — x n=0 


or ~ ~ 
> a,x" = (1 — x) ¥ A,X", 
n=0 n=0 


where A, = dg + a, + ++: + a, (for another proof, see Ruds., 
Prob. |, p. 85). 

Comment. If one of the two series converges in the interval 
(—R, R), where 0 < R < 1, then so does the other (why?). 


4. Prove the identity 


(, 1 x 1-3 x? 
—4f+u— 4+ ——— ——__ 4. ..- | x 
a 2a+2 *4a+4 


(14 A 4 Cee ee ; 
a+2 (a + 2)(a + 4) 
where a > 0. 


2 Fichtenholz (2094) 
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5. Suppose it were not known in advance that the exponential 
function obeys the “addition formula” 


ee” _ ety. (12) 


Prove that (12) follows from term-by-term multiplication of the 
SETIES 
x" 2 n 


x 
=1])+x+—4+-4+ 
2! 


n! 


(Ruds., p. 113) by the same series with x replaced by y. 
Hint. Use the binomial theorem. 


6. Suppose it were not known in advance that the sine and 
cosine functions obey the “addition formulas” 


sin (x + y) = sinx cosy + cosx sin y, 
cos (x + y) = cosxcosy — sinxsiny. 


Prove that these formulas follow from term-by-term multiplica- 
tion of the series 


2n-1 


sin x = a 
2D (2n — 1)! 
3 5 2 1 
~x—- 24% 1 4 (eye o, 
31 OS! (Qn — 1)! 
ba) 2n 
cosx = >) (-1)" ~ 
a (2n)! 
2 4 2 
=] — —++4— — -+ (-1Ir 
2! ! (2n)! 


(Ruds., p. 114), with appropriate changes of x to y. 


7. Find the square of the series 


1+ > (-yp 


x arbitrary). 
n=1 2?" (n!)? ( %) 
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Hint. First prove the combinatorial formula 
y (Cd? = Cp", 
k=0 


involving the binomial coefficients 


Cc = n! 2n (2n)! 
“kab! (ny? 
Ans. 
(2n)! x?" 
1)"* -———_.. 
1+ (- ) 22" (n)é 


8. Square the series 
| 
t=. = &>), 
n=1 Hh 
representing the Riemann zeta function (Ruds., pp. 11, 45). 


Ans. We have 
[Pr = > 


t(n) 
n=1 n* ° 
where t(n) is the number of positive integers dividing n. 


9. Let C(x) be the same as in the preceding problem. Prove 
that 


where {p,} is the sequence of all prime numbers greater than 1, 
arranged in increasing order.’ 


7. For example, p; = 2, p2 = 3, P3 = 5, pa = 7, 
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Hint. Clearly 


1 1 
=1 + x. + 2x + + mx + ; 
1 i Px k k 
Pr 
and hence 
1 2, 1 v1 | 
PY = =)’—=.—+ »” > (13) 
PREN _ i n=1 Nn n=1 NM n=N+1 
Pi 


where the prime shows that the summation does not extend over 
all positive integers, but only over those (except for 1) contain- 
ing the numbers p,, P2;..-; Px & N as factors. Therefore 
Yo 2] 
o<P™-y te y A, 
n=1 n* n=N+1 n*™ 
a fortiori. But the right-hand side approaches 0 as N—> oo (why?), 
and hence 
lim P?) = ¥ a 
N~+00 n=1 n* 


10. Prove that 


- ! = +00. (14) 


TEN w 


Deduce from this that there are infinitely many primes. 
Hint. Formula (13) continues to hold if x = 1, and hence 


(N) 1 ~ 1 
Py? =] ——— >  — = &,. 


kn 1 n=1N 
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11. Prove that the series 


1 


Leo} 
stgtetutot = 2 


1 +t sas) 
3 5 Px 1 Dx 
diverges. 

Hint. Since the product (14) diverges, the series (15) also 
diverges (Ruds., Theorem 5, p. 96). 

Comment. This serves to characterize the rate of growth of the 
prime numbers, and is clearly a much stronger result than the 


fact that the harmonic series diverges. 


12. Prove that 
1 


eo eon 


a1-t+41- 1,14... @en, 


where we use a plus or minus sign in the denominator of the ex- 
pression on the left depending on whether the factor in question 
involves a prime of the form 4n — | or of the form 4n + 1. 


5. Toeplitz’s Theorem 


We now prove a general limit theorem which will be needed 
later on (in Sec.6 and Chap.4): 

THEOREM (Toeplitz’s theorem). Given an infinite ‘‘triangular”’ 
matrix 


fay faa 


fa, tsa a3 


fn fy2 hs cot 
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of numbers tym (1 < im <n), suppose that the elements in each 
column converge to zero, i.e., 


tim 20 as n> (m fixed), qd) 


while the sums of the absolute values of the elements in each row 
are all bounded by the same constant K: 


Itai] + Ite2l tots + [tel < KO (nm = 1,2,...). (2) 


Let {x,} be any sequence converging to zero, and let {x;,} be the 
sequence with general term 


Xn = tarX, + taaX2 fot + tanXn- 


Then {x,} also converges to zero. 
Proof. Given any ¢ > 0, there is an m such that 


[x] <—— if n>m, 
2K 
and hence, by (2) 
|xnl < tat %1 tot tam%ml + \tasm+ 1%m+1 poe tnnXnl 
é 
< Ita1X1 poe tamXml + (ltn,m+11 poe taal) OK 


< [taix_ tot + tamXml + 5 if n>m, (3) 


But m is fixed in (3), and hence, by (1), there is an N > m such 
that 


\teiX. tot + tamXml <> if n> WN, (4) 


Combining (3) and (4), we find that 
Ix, <e if n>JN, 


ie, x,70asnoou. &f 


Operations on Series 23 


COROLLARY 1. Suppose the coefficients typ, satisfy the condition® 
T, = tar t+ tra to + fin > 1 
asin — 0, in addition to the conditions (1) and (2), and suppose 
lim x, =a 


azo 


(a finite). Then 


lim x, = lim (f,,%1 + fa2X2 ++ + tanXn) = @. 


A+ oO a> oO 


Proof. Clearly 
Xn = tat 1 — @) + tap 2 — @) + + ban Xn — @) + Tha, 


where, by hypothesis, x, — a—» 0 asn — oo. Hence, by Toeplitz’s 
theorem, 
lim x, = lim T,a=a. Ef 


na n> 


COROLLARY 2. If 


lim x, = a, 
nvm 
then 
_ Xp t Xp te + 4%, 
lim — 2 7 =a, 
a> "1 
Proof. Choose 
1 
tnt = tha = — tan — 
n 


in Corollary 1. If 
COROLLARY 3. Suppose 
lim x, = lim y, = 0, 


nc n+w>@ 


where 


yi + lyal tet lal < K (n = 1, 2,...) 


_-———. 


8. In the applications, we usually have 7, = 1. 
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for a suitable constant K, and let 


Zn = Xi Vn + X2Vn-1 tot + Xai. 
Then 
lim z, = 0. 
Proof. Choose tam = Ya—m+1 in Toeplitz’s theorem. 
COROLLARY 4. Suppose 


limx,=a, limy, = 5, 


and let oe ve 
Zz, = X1Vn + X2Vn-1 tt + Xai ; 
n 
Then 
lim z, = ab. 


nao 


Proof. First let a = 0. Then z, + 0, by Corollary 3, if we 
replace y, by y,/n, noting that |y,| < K (why does K exist?) im- 
plies 


< DK Lk. 
n 


ya 
n 


Ya 
n 


Jn 
i 


+ poet 


If a # 0, we write 


7 = (x; ~~ a) Yn + (x2 — A)Yn-1 te + —ayyi 
. n 
pg Weta tt Ia 
n 


Then the first term on the right approaches zero, for the reason 
just given, while the second approaches ab, by Corollary 2. 


PROBLEMS 


1. Given two sequences {x,} and {y,}, suppose that 
a) {y,} is an increasing sequence with limit + 00; 


b) lim =——""4=@ = (xp = yp = 0). 
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Prove that 
lim — = a. 
n+ Yq 
Hint. Choose 
tam = Yn — Vm-1 
Vn 
2. Given a sequence Xo, X1, X2;--+; Xn; «++; let 


xe CoXo + Cix; + Cox. +--+ + Cx, 


27 
where C;, is the binomial coefficient 


cee = 0,1, 2). 
m!(n — m)! 


Prove that x, > a implies x, > a. 
Hint. Let 


3. Given a sequence X9, X15 X25 +++, Xq3 +++, let 


x! Cox + Cixyz + Cpxgz? + + Chx,z" 
“vn . 


(1 + 2)" 


Coxoz™ + Cixyz"~1 + Cpx22"772 + + CPx, 


Xn , 
(1 + z)" 


where z > 0. Prove that x, — a implies x, > a, x} > a.’ 
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6. The Theorems of Mertens and Abel 


We are now in a position to prove a theorem generalizing 
Cauchy’s theorem on the multiplication of series: 
THEOREM 1 (Merten’s theorem). Given two convergent series 


Yo a, = Gy + ag to tater (1) 
n=1 
and 
Yb, = by) + bgt +b tee, (2) 
with sums A and B, respectively, suppose at least one of the series 


is absolutely convergent. Then the product of (1) and (2) in Cau- 
chy’s form is convergent, with sum AB, i.e., 


AB = a,b, + (a,b, + @yb,) + (aib3 + a,b, + a3b;) + -*. 
(3) 
Proof. Suppose the first series (say) is absolutely convergent, 
i.e., suppose the series 
> lanl = las} + laa] + +++ + lal + + (4) 
n=1 
is convergent. Combining terms on the nth diagonal of the 
matrix (3), p. 13 we write 
C2, = a,b, + a2b,_1 toe + Gy—152 + a,D,, 
so that the series on the right in (3) is just 
Cy + C2 + oo + Ch + meey 
with partial sums 
C,= Cy t eg tr + Cy (n = 1,2,...). 
Thus our aim is to show that C, + ABasn— oo. First of all, it 


is easy to see that 
C, = 4,B, + d2By—, + +++ + @n-1Bz + anB,, 
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where 8, is the nth partial sum of the series (2). Setting B, 
= B — 8, (where the remainder f, > 0 as n-— oo), we can write 
C, in the form 

C, = A,B — yn, 


where A, is the nth partial sum of the series (1) and 


Yn = 1B, + G2By_1 + +++ + Qq-1B2 + OB. 
Since A, > A, everything reduces to showing that 
lim y, = 0. 
But this follows at once from Corollary 3, p. 23 (with x, = 8,, 
Yq, = a,), if we bear in mind that 


|a,| + |a2| + --- + |a,| < A* (n = 1,2,...), 


where A* is the sum of the series (4). [i 

Example 1. It cannot be asserted that the series on the right 
in (3) converges if both series (1) and (2) are only conditionally 
convergent. For example, suppose we try to multiply the con- 
ditionally convergent series 

a n-1 

y DN Le Btat ¢(-1yrt Le 4... 

=! dn J 3 J n 


(Ruds., Prob. la, p. 76) by itself. This gives 
] ] 


Ivan Javan 1 


C= com 


] ] 
+ ———_—._ + = + —=— }. 
VkVn—k +1 Fal 
But |c,| > 1, since 
] ] 


SO — 
VkVn—-k+1 0 
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and hence 


diverges. 
Example 2. On the other hand, suppose we multiply the con- 
ditionally convergent series 


© (—1)-} 1 1 
In 2 = —— ] — + — ee 
> n 2 3 


1 
+ (-1)1— 4+ 
n 
(Ruds., p. 117) by itself. This gives 


Ch = (-1)""? x 


1 
x ~—t 4. 
l-n 2(n — 1) k(n —k + 1) n:1 


ix I 
= CI 2» n(n —k 4+ 1) 


_yya-1 a 
_foort sy (Ly 
n+I1 xK0\kK n—-k+1 
1 
=(-1)"7? 2 (1+ 54-42). 
n+] 2 


Thus {{c,|} is a decreasing sequence converging to zero (why?), 
and hence 


y Cn (5) 


= 
Wl 
_ 


converges by Leibniz’s test (Ruds., p. 73). It is now natural to 
ask whether the sum of (5) is (In 2)?. The answer is affirmative, as 
shown by the next theorem. 
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THEOREM 2 (Abel’s theorem). Given two convergent series (1) 
and (2), with sums A and B, respectively, suppose their product 


foe) 
Vice = Cy FHeg te toto 


is convergent, with sum C. Then 
C = AB. 
Proof. With the same notation as before, we easily find that 
C,+ Cy, +++ C, = A,B, + A.B,-1) + + A,B. 
It follows that 


lim Cy + Cr +- + C, 


rr) n 


= lim A,B, + A,B, tore +t AnBa-1 


A 00 n 


But the left-hand side equals C, by Corollary 2, p. 23, while the 
right-hand side equals AB, by Corollary 4, p. 24 (with x, = A,, 
Vn = ns a 


PROBLEM 


Suppose the power series 


wm 
> a,x" 
na=0 


has the interval of convergence (— R, R), where R < 1, and 
suppose the series converges (possibly only conditionally) at the 
end points x = +R. Prove that the identity in Problem 3, p. 17 
continues to hold for x = +R. 


CHAPTER 2 


Iterated and Double Series 


7. Iterated Series 


Given infinitely many real numbers 
aj” (j,k = 1,2,...) 


indexed by two integers j and k, imagine these numbers arranged 
in an infinite rectangular matrix 


(a) 0) 0) com 


a, ay as Qj 
2) (2 2 
at ay aS? --- as i. 
3) 3 3 
at as 3 aS? ... al a. 
(1) 
k k k k 
a® a® a® ...g®... 


Suppose we first sum the elements in each row of (1) separately, 
obtaining an infinite sequence of series of the form 


y ay (k = 1,2,...), (2) 


and then sum the terms of this sequence in turn, obtaining the 


expression w 
Pa a”, (3) 


ims 


30 
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called an iterated series. Alternatively, if we sum the matrix (1) 
first over columns and then over rows, we get another kind of 
iterated series, of the form 


y 2d ay”. (3) 


DEFINITION 1. Suppose summation of the elements in the kth 
row of (1) gives a convergent series, with sum A™, for every 
k = 1,2,..., and suppose the series 


» A® (4) 
k=1 


is convergent, with sum A. Then the iterated series (3) is said to be 
convergent, with sum A. 

DEFINITION 1’, Suppose summation of the elements in the jth 
column of (1) gives a convergent series, with sum A,, for every 
j= 1,2,..., and suppose the series 


» A, (4’) 


is convergent, with sum A’. Then the iterated series (3') is said to be 
convergent, with sum A’. 

The elements of the matrix (1) can be represented as an ordin- 
ary sequence 


Uy y Un, veey Upy vee (5) 


in infinitely many ways, and there is an ordinary series 


du, (6) 


corresponding to each such sequence.’ Conversely, given any 
ordinary sequence (5), the terms of the sequence can be arranged 
in infinitely many ways (without regard for order) to make up a 


1. A similar situation has already been encountered in connection with 
the matrix of the special form (3), p. 13. 
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matrix of the form (1), and there is an inerated series of the 
form (3), say, corresponding to each such arrangement. Thus it 
is natural to ask about the relation between the series (3) and 
(6). This is done in the following two theorems: 

THEOREM |. If the series (6) is absolutely convergent, with sum 
U, then, no matter how its terms are arranged as a matrix of the 
form (1), the corresponding iterated series (3) is convergent, with 
the same sum U. 

Proof. By hypothesis, the series 


yl 6) 


is convergent. Let U* be its sum. Then, given any & and n, 


Therefore 


since an absolutely convergent series is always convergent 
(Ruds., Theorem 1, p. 63). Moreover, given any « > 0, there isan 


integer ro such that 
oo 


» lel <e, (7) 
r=rgotl 
and hence, a fortiori, 
fo) Ta 
Y uf=]o- Zul <e (8) 
r="fotl r=1 
The terms u,, U2, ..., u,, of the series (6) all belong to the first m 


columns and the first n rows of the matrix (1) if m and n are 
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sufficiently large, say if m > mg, n > No. Therefore, by (7), 
Ly vaP—-Yu 
k=1jf=1 rel 


since the expression whose absolute value appears on the left isa 
group of terms u, with indices greater than ro. Taking the limit 
as m— ©O, we get 


<eE (m > Mo,n > Na), 


” ro 


y Awe) — Y. Uy 


k=1 r=1 


<e (n > No), 


which, together with (8), implies 


> Ate) _ u| < 2¢, 
k=1 
and hence 


feo) n 
y AM = lim Y AM =U. Ei 
k=1 nn kK=1 

Remark. Theorem 1 obviously continues to hold in the case 
where some of the rows of the matrix (1) contain only finitely 
many terms. 

DEFINITION 2. The iterated series (3) is said to be absolutely 
convergent if the iterated series 


Yash, 9) 


whose terms are the absolute values of those of (3), is convergent. 
Remark. Similarly, the iterated series (3’) is said to be absolute- 
ly convergent if the series 


is convergent. 

THEOREM 2. Suppose the iterated series (3) is absolutely con- 
vergent. Then (3) is convergent, and the series (6) made up of the 
elements of (1) arranged in any order whatsoever is absolutely 
convergent, with the same sum as (3). 


3. Fichtenholz (2094) 
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By hypothesis, the series (9) is convergent. Let A* be its sum. 
Then, given any m and n, we have 


Ms: 


k 


y. ay? | < A*. (10) 
1j=1 
Consider any partial sum 
UF = |us| + lua] + + lel 


of the series (6*). The numbers u,, u2,..., u, all belong to the 
first m columns and the first n rows of the matrix (1) if mandn 
are sufficiently large. Hence (10) implies 


U* <A* (r=1,2,...), 


so that (6*) is convergent, i.e., (6) is absolutely convergent. The 
rest of the proof is now an immediate consequence of Theo- 
reml. 

Remark. Clearly, Theorems 1 and 2 remain true if (3) is re- 
placed by (3’). 

THEOREM 3. Given a matrix (1), suppose the iterated series (3) is 
absolutely convergent. Then the iterated series (3') converges and 
has the same sum as (3): 


Proof. By Theorem 2, the series made up of the elements of (1) 
arranged in any order whatsoever is absolutely convergent. 
Hence, by Theorem 1, the iterated series (3) corresponding to the 
matrix (1) as it stands and the iterated series (3’), which is of the 
form (3) if we interchange rows and columns in the matrix (1), 
both converge and have the same sum. [ff 

Remark, Clearly Theorem 3 remains true if we interchange the 
roles of (3) and (3’). 
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PROBLEM 


Interpret Theorem 1 as a generalization of both Theorem 1, 
p. 1 and the theorem on p. 5. 


g. Double Series 


There is another kind of series associated with the infinite 
rectangular matrix (1), p. 30, namely the series of the form 


apap ae talP + 
$a 4 ay tee tal? 4 
rae 
tap tate +a 4 
octeeee 


called a double series and denoted by 


Ls 9) 


y af? () 
Jsk=1 
(with only one summation sign). By a partial sum of (1), we 
mean a finite sum of the form 
m n 
Am = ¥ ¥ ai, 
f=1k=1 
made up of the terms in the first » columns and the first n rows 
of the given matrix. Let m andn approach infinity independently. 


Then the limit? 
A = lim AX? (2) 


MD 
n-* 00 


2. The limit in (2) is a double limit. Thus if A is finite, (2) means that, 
8iven any « > 0, there is an integer N such that 


|AM — Al <e 


m 


whenever m and both exceed N. 
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(finite or infinite) is called the sum of the double series (1), and 
we write 


The series (1) is said to be convergent if it has a finite sum, and 
divergent otherwise. 

It is now natural to compare the double series (1) with the 
iterated series 


> oY 
as (3) 
kK=17=1 
and 
foo] foo] 
k 
>» ¥ af”. (3’) 
J=elk=1 
Since 
n m 
4Pp=>y ¥ a‘, 
k=1J=1 
we have 


lim AP = YAM, 
k=1 


ma 


after taking the limit as m — oo for fixed n. Here 
oc 
A® = a (kK =1,2,...), (4) 
res 
and every “row series” on the right is assumed to converge. Thus 
the sum of the iterated series (3) is just the iterated limit 


lim lim Ay. 


Similarly, the sum of (3’) is the other iterated limit 


lim lim A‘? 


MOO RA 


(give the details). 


THEOREM 1. If the double series (1) converges and if every “row 
series” (4) converges, then the iterated series (3) also converges and 
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has the same sum as the double series: 
co i+ of 
LY yaP= Ma’. (5) 
k=1/jf=1 Jk= 
Proof. Given any « > 0, there is an integer N such that 
An? ~ Al <e, 


provided that m,n > N. Holdingn > N fixed, we take the limit 
as mi — 0, obtaining 


Y 40 Al ce. 


k=1 


Taking the limit as n > oo now gives 


wo 


y 40 A) ce, 


k=1 


which implies (5). [jf 

Remark. There is an obvious analogue of Theorem 1 for the 
case of the iterated series (3’). 

DEFINITION 1. A double series (1) such that 


a’ >0 Uk =1,2,...) 


is said to be positive. 

For such series we have the exact analogue of a familiar result 
for ordinary positive series (Ruds., Theorem, p. 9): 

THEOREM 2, A positive double series always has a sum. The sum 
is finite, and hence the series converges, if the partial sums of the 
series are bounded from above. Otherwise the sum is infinite, and 
hence the series diverges. 

Proof. The last assertion is obvious. To prove that a positive 
double series (1) converges if its partial sums are bounded, 
Suppose 

AMP <K (mn =1,2,...), 
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and let A be the least upper bound of the numbers A“. Then A 
is the sum of (1). In fact, given any ¢ > 0, there is a partial sum 
Ane such that 

Ano >A—eé, 


by the very definition of A. Choosing m > mg,n > ng, we have 
An >A-e, 


a fortiori, since A“ obviously increases with both m and n. 
Hence 
A? — Al <e 


if m,n > N = max {mg,Nno9}, since no partial sum exceeds A. 
But then 


: () 
A=limA,, , 
mo 
nwo 


as asserted. I 

Next we consider arbitrary double series, i.c., double series 
whose terms can have values of either sign. Just as in the case of 
ordinary series, we need not consider the case where all the terms 
of the series are negative or the case where there are only a finite 
number of positive or negative terms, since these cases immedi- 
ately reduce to the case of positive series (cf. Ruds., p. 63). Thus 
we will assume that the double series (1) has both infinitely many 
positive terms and infinitely many negative terms. 

The following definition and theorem are the exact analogues 
of those for the case of ordinary series (Ruds., pp. 63, 65): 

DEFINITION 2. A double series (1) is said to be absolutely 
convergent if the series 


>, lay | (1*) 
Joke 


made up of the absolute values of its terms is convergent. A double 
series which is convergent but not absolutely convergent is said to 
be conditionally convergent. 
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Remark. Thus (1) is absolutely convergent if and only if the 
double series corresponding to the infinite rectangular matrix 


Jay? | fae? |e ag?) 
2 (2) 2 
lay? Jay | «+ Ja] 

(k) (Ky) k 
lav | las} «+ jaf] 


is convergent. Similarly, the interated series (3) and (3’) are ab- 
solutely convergent if and only if the iterated series correspond- 
ing to this “absolute value matrix” are convergent (cf. Defini- 
tion 2, p. 33). 
THEOREM 3. If the series (1*) converges, then so does (1). 
Proof. Let 


(kK) _(k) (k) 
a; =Pjy —4Qj> 
where 
(k) (k) ; 
wy — [az | + 4; ay — 14; i 
Py = ———: GQ = — 
2 2 
Since 
(k) (k) (k) (ky 
P; <la; |, 9g; < lay l, 


the convergence of (1*) implies that of the double series 


(see Problem 5). But then the series 
ya = 5 (oP — a) 
j,kK=1 J,k=1 


also converges (see Problem 3), and in fact has the sum A = 
P—Q. i 

Finally we prove a result analogous to Theorems | and 2 of 
the preceding section: 


40 Infinite Series: Ramifications 


THEOREM 4. Given a double series (1), let 


o 


du, (6) 
r=1 
be an ordinary series consisting of the same terms written in any 
order whatsoever. Suppose either of the series (1) and (6) is ab- 
solutely convergent. Then so is the other series, and both series 
have the same sum. 

Proof. Suppose (1) is absolutely convergent, so that (1*) is 
convergent with sum A* (say). Then, just as in the proof of 
Theorem 2, p. 33, it is easy to see that 


U* < A* (r = 1, 2,...), (7) 
where 
UF = |uy| + [ual + + + [ul 


is the rth partial sum of the series 
> let. (6*) 
r=1 


But (7) implies the absolute convergence of (6). 
Conversely, suppose (6) is absolutely convergent, so that (6*) 
is convergent with sum U*. Then, given any partial sum 


AR = YY fa\| (8) 
J=1k=1 
of the double series (1*), there is an integer r so large that all the 
terms in the right-hand side of (8) are among the first r terms 
of (6). It follows that 


AX™ <U* (mn =1,2,...), 


which in turn implies the absolute convergence of (1), or, for 
that matter, of either of the iterated series (3) and (3’). 

Finally, to calculate the sum U of the series (6), we use its 
absolute convergence to suitably rearrange its terms. Suppose 
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we enumerate the terms of (6) “by squares,” amalgamating the 
groups of terms by which consecutive squares differe from each 
other in the array 


(1) 
2 


(2) 
2 


Then 


(1) 2) 2 1 
U =a? + (a? + ay? + af?) 


(3) (3) 


+ (a? + a3 3) 


2 
+ a3 (2) 


tas? t+ as?) te, 


and hence 
U =lim A” = A, 

where A is the sum of the double series (1). Hi 

CoroLLary. The double series (1), the ordinary series (6) consist- 
ing of the same terms written in any order, and the iterated series 
(3) and (3’) all converge and have the same sum, provided at least 
one of the four series is absolutely convergent.* 

Proof. Combine Theorem 4 with Theorems 1-3 of the preced- 
ing section. ff 


PROBLEMS 
i. Given two convergent series 


Y a; = ay + a2 + wan + qj; + wae (9) 


J=1 


3. The word “absolutely” is unnecessary if all four series are positive. 
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and 


Yb, = by + bg +o + by tn, (10) 


k=1 


with sums A and B, respectively, consider the double series 


cP = Y ajpby. (11) 
dvk=1 dk=1 


Prove that (11) converges and has sum AB. 
Hint. In terms of partial sums, 


Cr = AnBn, 
and hence, 
C=1im A,B, = AB. 


Comment. Thus, if we define the product of the series (9) and 
(10) as the double series (11), the sum of (11) always equals the 
product of the sums of (9) and (10). The niceties of Secs. 4-6 
arise only when the product of (9) and (10) is taken to be an 
ordinary series. 


2. Suppose every term of a convergent double series with 
sum A is multiplied by the same constant c. Prove that the result- 
ing series converges and has sum cA. 

Comment. This problem and the next two generalize familiar 
properties of ordinary series (Ruds., Theorems 3~5, pp. 7-8). 


3. Prove that two convergent double series can be added (or 
subtracted) term by term. 


4. Prove that if the double series 


~ k 
a 


converges, then 
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Hint. Note that 


k k k k-1 k~1 
ay? = Ay? — AS, — AF + AMA”. 


5, State and prove the analogue for positive double series of 
the comparison test for ordinary positive series (Ruds., Theo- 
rem 1, p. 12). 


9, Examples 


We now give a number of example illustrating the theory of 
the preceding two sections. 
Example I. Consider the infinite rectangular matrix 


2 3 


x —x? x —x3 x 
x(l-x) —x?(1—x?) x? (l—-x?) —x3 (1-3) x3(1—x3) 


x(l—x)? —x?(1—x?)? x7 (1 —-x?)? —x3 1 — x3)? x8 (1x3)? + 


Here the “row series” are absolutely convergent, with sums x, 
x(i — x), x(1 — x)?,..., and the series made up of these sums 
is also absolutely convergent, with sum 1. However, the other 
itcrated series docs not converge, since the ‘‘column series’’ have 
sums alternately equal to +1 and —1. This does not contradict 
Theorem 3, p.34, since neither iterated series is absolutely 
convergent (why not?). 

Example 2. Suppose q ranges over all positive integers of the 
form m", where m and n are both positive integers greater than 1, 
taking each such value just once. Prove that 


| =1. 


G=5 


4q q-1 


Solution. If m ranges over all positive integers (> 1) which are 
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not powers, then 
1 1 
G= + 
are Loy 
1 1 
= + + 
ae m> — 1 } 
1 1 1 
= —-+—+—+ 
r\( m*  m*® ) 
+ (5+ an ae 


m 
=>) (<5 tweecp teen” 
™ m? (m2 —1) mm (m3 — 1) 
(justify the various rearrangements). It follows that 
gee 1 
n=2 n(n — 1) 


where n now ranges over ail positive integers starting from 2. 


Therefore 20 1 1 
e-$(4+-2)- 
n=2\n — { nh 
Example 3. Consider the matrix with general term 
(k — 1)! (j — 1)! 


(k) 
OS FG+DG+H kk+D~k+) 
(where 0! = 1). Setting « = 0, p = k in the formula 
y 1 
nm=i(atny(atn+1)--(a+n + p) 
= ——__+___ (1) 
P(a + p)-- (a + p) 
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(Ruds., Prob. 2, p.4), we can easily sum the terms of the 


kth row: 
2p = 
me? kk! k? 
Hence the sum of one iterated series is 
oO io a) fa) if 
LLa= ys. (2) 
k=1j=1 k=1 k 


Because of the symmetry of a with respect to j and k, the other 
iterated series is identical with the first, and nothing new can be 
deduced by equating the sums of the two iterated series. 
Suppose we now modify the matrix as follows: We retain the 
first kK — 1 termsin the kth row, but replace the kth term by the 
sum of all the terms of the kth row starting from the Ath, drop- 
ping the remaining terms altogether. This gives the new matrix 


(k) (k) (k) (k) 
ay a2 a3 s Q-y Ve 
(k+1) (k+l) (kta) (k+1) th+4) 
ay a2 a3 **' Ak) Ay Pett 


with the same “row sums” as the original matrix. Hence the sum 
of the first iterated series has the same value (2) as before. To 
sum the matrix “by columns,” we first calculate 


2 wy @ (k — 1)! 
em B= LoGa pee 
_2 (k — 0! 
= 2 (kK—14n)+-Qk —-14+n) 
(k — 1)! 


= 5 Zi Le 3 
k2 (k + 1)- (2k — 1) ©) 
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using formula (1) with a = k — 1, p =k. The sum of the re- 
maining terms of the Ath column equals 


a0 . o — 1)! 
y al? = oy (k 1)! 
i=k+1 i=k+1 (i+ 1)--G@+k) 
_ y (k — 1)! 
n=1 (K+ nj(K+n+1)-- Qk +n) 
k — 1)! 
_ a (4) 
k(k + 1)--- 2k 
where we set « = p = k in (1). It follows from (3) and (4) that 


the sum of all the terms in the kth column is just 


(k — 1)! (: 1 
k(k + 1) (2k — 1) \k x) 
_ (k — 1)! 3 (kK — It? 


k(k + 1) (2k — 1) 2k (2k)! 


Using Theorem 3, p. 34 to equate the sums of the two iterated 
series, we arrive at the interesting formula 
an > Tk — 1)! 


y o=3) 


m1k? 1&1 2K! ©) 


The series on the right converges very rapidly, thereby facilitat- 
ing the approximate calculation of the sum of the important 
series on the left.* 

Example 4. Investigate the convergence of the double series 


1 
———— 0). 6 
ike (j + ky >) ) 


4. An argument which will not be given hcre shows that this sum equals 
z7/6. See G.M. Fichtenholz, Functional Series (in the Pocket Mathemat- 
ical Library), Scc. 7, Problem 7b. 
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Solution. Arrange the terms of (6) as an ordinary series, com- 
pining terms on each diagonal of the corresponding matrix. 
Since the terms on each diagonal are equal, this gives 


ag 1 
» (v-1)—. (7) 
n=2 nN 

But clearly 


1 
—n<n-l<n”, 
2 


and hence, dividing by n’, we get 


1 1 


2 n?? 


1 


ao-1" 


<(n- jptie< 
n°? 


It follows by the comparison test that (7) converges ifo > 2 and 
diverges if o < 2. Therefore, by Theorem, 4 p. 40, the same is 
true of the double series (6). 


PROBLEMS 


1. By applying Theorem 3, p. 34 to the positive matrix 
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(the missing elements can be replaced by Zeros), prove that the 
harmonic series 


1 1 
1+ —+--4+— 4+: (8) 
2 n 


must diverge. 

Hint. If (8) had a finite sum s, then one iterated sum would 
equal s, while the other would equal s — 1, contrary to the theo- 
rem. 


2. Prove that 


ios} wm 1 
m=2k=2 m* 
(the same power can occur more than once in the left-hand side). 


3. If |x| < 1, the Lambert series 


as) = Yay 


* 9) 


converges for precisely the same values of x as the power series 
f(®) =), ayx" (10) 
n=1 


(Ruds., Prob. 3, p. 86). Let R > 0 be the radius of convergence 
of the series (10) and suppose |x| < R as well as |x| < 1. Prove 
that 


where 


and k|n means that the sum is restricted to those positive integers 
which are divisors of n. 
Hint. Noting that 


x 
1-— x 


= XT + XM Hoe +m oe — ([x] < 1), 
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consider the matrix 


Q,X A,X? a,x? a,x* a,x> ayx® a,x7 a,x® a,x? a,x? 


a2x? a,x* a,x® a,x® a,x1°... 
a3x3 a3x® a3x? 
a4x* 4x8 
a5x° asx} 
agx® (11) 
a,x" 
3x8 
Agx? 
19X19 = 


where identical powers of x appear in the same column and 
empty spaces can be replaced by zeros. Now equate the corre- 
sponding iterated series (why is this justified?). 


4, Prove that 


Il 
M 
ot 
= 
= 
her 
tad 
wo 


Toe 


where r(n) is the number of divisors of n and a(n) is the sum of 
the divisors of n. 

Hint, Use the result of the preceding problem. 

Comment. It is easily verified that R = } in both cases, so that 
we need only assume that |x| < 1. 


4 Fichtenholz (2094) 
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5. Prove that 
oe) = Y £0"), (12) 


where the functions » and fare the same as in Problem 3. 
Hint. Arrange the elements of the matrix (11) without “gaps,” 
in the form 


Q,X GX? ayx* a,x* « 


Q,x? a_x* a,x® a,x® «+ 
Q4X3 a4x® ayx? ayxt? 


a4x* agx® agx}? ayx'® -- 


6. Prove that 


oo (ax)" _ oo 
» l-x » 1 ax" (la| < 1, {x| < 1). 


Hint. Use (12), choosing a, = a”. 
7. Given two power series 
f(x) = Y GnX™, B(x) = Y b,x", 
m=1 n=1 
prove that 
Y ane (x) = Y BLO) (xl <1), 


where x is such that both series converge absolutely. 
Hint. Consider the matrix with elements a,,b,x", noting that 


|ambnX”"| < |aq_X™| |b,x"| » 


since mn 2m +n(m> 1,n > 1), from which it follows that 
the corresponding double series is absolutely convergent. 
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Comment. The choice b, = 1 (n = 1, 2, ...) gives (12), since 
then 


g(x) = lox 


8. Prove that the “power series in two variables” 
> xty* (13) 


is absolutely convergent if |x] < 1, |y| < 1 and divergent other- 
wise. 

Hint. Use Cauchy’s theorem (p. 14), noting that (13) is the 
product of the two ordinary power series 


oc oc 
yx DY yt 
i=0 k=0 
Comment. The study of power series in two variables is pur- 
sucd in the next section. 
9. Prove that the double series 
a 1 
— (x > 0, B > 0) 
jar j*kF , 
is convergent if « > 1, 8 > 1 and divergent otherwise. 


10. Consider the double series 


® 1 
— >0), (14) 
1? wees (Aj? + 2Bik + Ck)? (e ( 


mM 
a 


where the quadratic form Ax? + 2Bxy + Cy? is positive defi- 
nite, so that A = AC — B* > 0, as well as A > 0, C>0. Prove 
that (14) converges if 9 > 1 and diverges otherwise, thereby 
generalizing Example 4. 

Hint. If M is the largest of the numbers | A], |B] and |C], then 


Ms 1 to 
© MY (f+ ke) 
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Moreover 


k) 
ay = 


Q Q 
a” < c —_ > a? < A Ji > 
Aj} j* Aj} k® 
which implies 
ae < (Ae Ac\ 1 
A jek? . 


11, Give an example showing that in Theorem 1, p. 36, one 
cannot drop the condition that every row series be convergent. 
Hint. The double series corresponding to the matrix 


[(AC — BY) j? + (Bj + CK] > <7, 


and hence 


is Convergent, with sum zero, but its row series diverge. 


12. Sum the following double series: 


—_ — * b . 
Deseme PTO D2 Gye? 
ae 1 ~ 1 
9 oe, (4n — 1)2™+3 ” woes (4n — 1)?" ° 
“ 1 


°) as (4n _ 2)?" , 
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Hint. Resort to iterated series, first summing over m. Use the 
expansions 


preity tidy... 
2 3 4 
M4 1 1 1 
—=)]-—+—-—-—+4+: 
4 3 5S 7 
(Ruds., pp. 115, 117). 
Ans. 
a) ; b)In2; cy % —~1 ino, dt ina; ce) =, 
pt+l 8 2 4 8 


/3. Consider the function of two variables 


p(x, z) = 72-7) (2 £0). 
Prove that 


p(X, Zz) = 2 JX) 2", (15) 
where 
ow (—1) x 2k+n 
J(x) = —_+— f — 
) eo kik 4 ml (5) 
ifn > O and 
oo (—1)* x 2k+n 
L(x) = af 
“) Gea) 


ifn < 0. Show that 
J_,{(x) = (- 1)" I(x) . 
Hint. Multiply the absolutely convergent series 


erie _ y x 7 zt eo (x/2) 2-1 y x (-1)* z—* 
fo\2) jl’ K=0 \2 k! 


(Ruds., p. 113) to get the absolutely convergent double series 


g(x. 2) = y (3) (-1) gin k, 


ik=0 \ 2 ji k! 


5. > a,isshorthand for thesum > a4,+ > ay. 


N=—00 n=0 a=l1 
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Comment. The function J,(x) is called the Bessel function of 
order n, and plays an important role in mathematical physics, 
celestial mechanics, etc. Because of the expansion (15), the func- 
tion (x, z) is called the ‘“‘generating function” of the Besse] 
functions. 


10. Power Series in Two Variables 


By a power series in two variables x and y is meant a double 
series of the form 


aj,xIy ‘, (1) 


*Me 


involving nonnegative integral powers of the variables x and y 
roultiplied by numerical coefficients a,,. Just as in the case of 
ordinary power series in a single variable (Ruds., Sec.11), we 
now consider the problem of finding the ‘‘region of convergence” 
of (1), i.e., the set of all points M = (x, y) for which (1) con- 
verges. 

Lemma. [f the power series (1) converges ata point M = (, y) 
whose coordinates are both nonzero, then it converges absolutely at 
every point M = (x,y) satisfying the inequalities |x| < |x|, 
ly| < jl, i.e., in the whole open rectangle with center at the origin 
and vertex at M. 

Proof. The proof is virtually the same as in the single-variable 
case (Ruds., p. 68). Suppose the series 
ie 6] 

ay xy* 
k=0 


Js 
converges. Then its general term approaches zero (see Problem 4, 
p. 42), and hence is bounded, i.e., 
|ay,xt y*| < C CG, k = 0, 1, 2, w+) 


for some constant C. Therefore 


|ay,x4y*| = |a,,x/y*| 


<a |< 
YY 
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But the expression on the right is the general term of a conver- 
gent double series (see Problem 8, p. 51), provided that |x| < [Z], 
ly| < ly]. It follows by the comparison test (see Problem 5, p. 43) 
that (1) is absolutely convergent and hence convergent, by Theo- 
rem 3, p.39. 

Remark 1, The only power series in two variables to be con- 
sidered here are those for which there exists a point 7 satisfying 
the conditions of the lemma. 

Remark 2. It is clear from the lemma that we need only study 
the behavior of the series (1) in the first quadrant of the xy-plane, 
since if (1) converges at a point M = (x, y), it must also converge 
at the points obtained by reflecting M in the x and y-axes as well 
as in the origin. 


P My * 
Figure 1 


Consider a ray OL in the first quadrant, making angle 6 with 
the positive x-axis (see Figure 1). Then, by the exact analogue of 
the argument in the single-variable case (Ruds., p. 69), there is a 
Positive number R(8), possibly infinite, such that the series (1) 
converges absolutely for every point M on OL satisfying the 


sg 
condition OM < R(6) 


and diverges for every point M on OL satisfying the condition 
OM > R(6). 


6. The distance from O to M is denoted by OM. 


56 Infinite Series: Ramifications 


Note that if R(#) = +00 for even a single ray, then, by the 
lemma, the series (1) converges (absolutely) in the whole xy- 
plane, i.e., the ‘region of convergence” reduces to the whole xy- 
plane. 

Excluding this case of an “everywhere convergent” series, we 
now assume that R(6) is finite for all 6. Let M, be the point of 
the ray OL such that 


OM, = R(8). 


Then the “boundary point” M, separates the points of the ray 
for which (1) converges (absolutely) from the points for which 
(1) diverges. At the point M, itself, the series (1) may or may not 
converge, depending on the particular series under considera- 
tion. Drawing the vertical line PP’ and the horizontal line QQ’ 
through M,, as shown in the figure, we can assert (using the 
lemma) that the series certainly converges inside the rectangle 
OPM,Q and diverges inside the (right) angular sector Q’M,P’. 
Therefore on a new ray OL’, corresponding to another angle 0’, 
the series must converge at every point of OA and diverge at 
every point of BL’. Hence the boundary point M,, must lie be- 
tween A and B on OL’. This makes it clear (why?) that R(@) 
varies continuously as 0 varies from 0 to 2/2. In other words, the 
point Mg, describes a continuous “boundary curve” as 6 varies 
from 0 to 2/2. Since the abscissa xg of the point M, is non- 
decreasing as @ > 0 while the ordinate y, of M, is nonincreasing, 
xX, and y, must both approach limits as 9 > 0. Hence R(@) must 
also approach a limit as 6 > 0. Suppose this limit 
Ryo = lim R(8) (2) 
640 

is finite. Then, as 6 > 0, M, approaches a limiting point Mé¢ 
=(R,, 0) on the x-axis.” If (2) isinfinite, the boundary curve must 


7. The limiting point 4 need not coincide with the boundary point My 
on the x-axis itself. In fact, My may lie to the right of M* (or even lie at 
infinity). This possibility does not contradict the lemma, which applies only 
to points off the coordinate axes. 
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have an asymptote parallel to the x-axis, which may coincide 
with the x-axis itself. The same considerations apply to the case 
where 6 — 2/2, with the roles of the x and y-axes interchanged. 

The above construction gives the boundary curve in the first 
quadrant. To complete the construction, we now reflect this por- 
tion of the boundary curve in both axes and in the origin. This 
gives the full boundary curve, determining the “region of con- 
vergence” #. In fact, the series (1) converges in the part of the 
plane lying inside the boundary curve and diverges in the part of 
the plane lying outside the curve.® On the boundary curve itself, 
the series may or may not converge, depending on circumstances. 


PROBLEMS 


1, Sketch the region of convergence for the series 
xly* (3) 


(already considered in Problem 8, p. 51). 
Ans. The square shown in Figure 2. 


Figure 2 


8. Except possibly on the parts of the coordinate axes lying outside the 
curve, where it may turn out that the series converge (see footnote 7). 
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2. What is the sum of the series (3) in its region of convergence? 
1 1 


“J-x1l-y. 


Ans 


3. Find the region of convergence of the series 


Mes 


differing from (3) in that the summation indices begin with 1 
rather than 0. 

Ans. The same square as in Problem 1, together with the co- 
ordinate axes themselves. 

Comment. In this case, even though the boundary point M, 
approaches the point Mf = (1, 0) as 6 0, the series converges 
on the whole x-axis (cf. footnotes 7 and 8). 


4, Find the region of convergence of the series 


xsyk 


Ms 


ico jt kl 
Ans. The whole xy-plane. 


5. Find the region of convergence of the series 


GED aye 4 


gk=0 jlk! 


Hint. A necessary and sufficient condition for the absolute con- 
vergence of the series (4), i.e., for the convergence of the series 


~ (j+k)! , 
y GED iy, (4) 
jk=0 lk! 


is the convergence of the series 


lx] + [yt = ——-—_ 
2p + = a 
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obtained by summing (4’) “‘by diagonals.” This leads to the con- 
dition |x] + |y] <1. 
Ans. The square shown in Figure 3. 


y 


Figure 3 


6. Find the region of convergence of the series 
YMyKa= Lt xt x?per + xy t xPyt By ter 
idk 
+ x?y? + x3y? + xty? toe, (5) 
Hint. A necessary and sufficient condition for the absolute 
convergence of the series (5), i.c., for the convergence of the 
series 
> Ix lvl, (5‘) 
IBk 


is the convergence of the series 
CL + |x| + [x]? + 2) + [xy + [ay]? + +) 


I 
1 — |x| 1 — |xyl 


obtained by summing (5’) “by rows.” This leads to the condi- 
tions |x| < 1, |xy| < 1. 
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Ans. The region shown in Figure 4, bounded in part by the 
equilateral hyperbolas xy = +1. 


Figure 4 


7. Generalizing double series, discuss multiple series of the 


form? 
foo} 


Y Qik (6) 


Jiki bs 


and power series in several variables, of the form 


Y jy. XIy* ez? 
Jik,..., =O 


How should the sum of a series like (6) be defined? 


9. In discussing iterated and double series, we favored the notation a) 
over the simpler notation aj, merely to emphasize the distinction between 
rows and columns in the infinite matrices figuring in Secs. 7-9. 


CHAPTER 3 


Computations Involving Series 


11. General Remarks 


We now consider the problem of using infinite series to make 
approximate computations. Suppose we want to calculate a 
number A which is known to have a series expansion of the form 


A=a,t+a,t--+a, +, (1) 


where the terms a,, @2,... are readily computable.! Then we 
have the approximation 


ARMA, = 4; + a, +-++ a, 


where A, is the nth partial sum of the series (1). The error com- 
mitted in making this approximation is obviously just the sum of 
the omitted terms, i.c., the remainder 


Xn = An4y + Unga toe 


(after n terms). Clearly, x, can be made arbitrarily small for 
sufficiently large n. Our job is to find simple estimates for «,. 
We will then be in a position to determine the value of n for 
which A, approximates A to within any given accuracy. 

If (1) is an alternating series whose successive terms decrease 
in absolute value, i.e., if (1) is a series of the Leibniz type, then the 
remainder «x, has the same sign as its first term and a smaller 
absolute value than its first term (Ruds., p. 74). Thus, in this 


1, In fact, the terms @;, @2,... are usually rational numbers. 
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case, we already have at our disposal a technique for estimating 
&,, Which leaves nothing to be desired from the standpoint of 
simplicity. The situation is more complicated for a positive 
series. To estimate the error «,, we look for another, easily 
summable positive series whose terms are larger than the cor- 
responding terms of «,. For example, in the case of the series 


Sd 


we have the estimate? 
“ 1 is 1 


ax = — —————— 
. m=n+1 m? m=n+1 m(m _ 1) 


2 1 1 1 
ier a)-t 
m=nt+1 \m — 1 m n 


Remark. One is ordinarily interested in decimal approxima- 
tions to the number 4A, although the terms a,, a,,... rarely turn 
out to be terminating decimals. Thus the “round-off error’ 
committed in writing a,, a2, ... in decimal form must be taken 
into account, as well as the “truncation error” a,. 

Even when the series (1) has simple terms and a remainder 
which is easily estimated, it often fails to be a practical way of 
calculating A, due to its having too slow a rate of convergence. 
In other words, the partial sums 4,, A,,... may approach their 
limit A too slowly as n > oo. For example, the series 


i 


1 1 1 
1-—+2--— 4+, 
2 3 4 0) 
1 1 1 
}-—4+2-—+-. 
3 5 7 


converge to In 2 and 2/4, respectively (cf. Problem12, p. 52). 
However, to calculate these numbers to within 10-5, we need 
100,000 terms in the first case and 50,000 terms in the second 


2. The same estimate has already been found in Ruds., formula (6), 
p. 45, in connection with the integral test. 
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case! Obviously, such calculations are feasible only with the help 
of a high-speed calculating machine. As will be shown in the next 
section, it is not very hard to find series expansions of x and In 2 
which converge much more rapidly than (2). 


PROBLEM 


Let «, be the remainder after n terms of the series 


~ 1 
1+ ¥ — 
m=1 m! 
Prove that 
Xn < J 
nin 
Hint. Note that 
eee ee ee 13 3 
m=nt+i m! n! manti (n+ 1)--m nt! manti (n+ ye" 


12. Examples 


The following examples illustrate the technique of using series 
to make numerical computations: 

Example 1. Find a rapidly convergent series suitable for cal- 
culating 2. 

Solution. Setting x = 1]V 3 in the expansion 


x3 xs x? 
arctan X= x — T= tt (-1<x <1) 


(Ruds., p. 115), we obtain 


FA 1 
— = arc tan —= 
3 
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which is much more suitable for calculating z than the slowly 
convergent series 


1-—+ 


tose 


pla 
II 


J ,i_i 
3° 5 7 


To get a series which is even more suitable for calculating x, let 


1 
& = arctan —. 
5 


Then 
Z 5 
tana =—, tan2a =——=—, 
1-2 612 
10 
tan 4a = 12 120 
25 119 


Since tan 4« is close to 1, it is clear that the angle 4« is close to 
x/4. Setting 


EA 
=4a—-—, 
B 4 
we have 
120 
— ,— 1 1 
tan B = 2 =—, 
B 1+35 239 
so that 


B = arctan = 
It follows that 


a = l6x — 4B 


~bd yy g(t tg.) 
11 5%! 239 3 2395 


This series is very rapidly convergent (see Problem 2). 
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Example 2. Find a rapidly convergent series suitable for cal- 
culating In 2. 
Solution. Setting 


1 
x= 
2n+ 1 
in the expansion 
] 2 4 
In-7* = axf14 242% 4...) (x <0 
1—x 3 5 


(Ruds., p. 117), we get 


n+] 2 1 1 1 1 
In = 1 +——_____ + — ____ } ... 
n Qn +1 3 Qn+1)? 5 (2n+ 1)* 


(2) 
(cf. Ruds., p. 124). For n = 1, this gives the rapidly convergent 
series 
In2 = 2 r+ttytti.. (3) 
3 3 9 5 9? 


(see Problem 3). 
Example 3. One way of calculating roots is to use a table of 
logarithms. Another way is to use the binomial series 


mi(m — 1) e 


(1+ xy"=14+mx+ rT 


+ x84 (Ix1< 1) (4) 


. kfT 
(Ruds., p. 120). Let a be an approximate value of the root VA, 
where @ may be an overestimate or an underestimate. To im- 
Prove this approximation, suppose, say, that 


A 
a 


=l1+x, 


5 Fichtenholz (2094) 
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66 
where [x] is a small proper fraction. Then 
Van ar/4 =a + xpi, (5) 
V ak 


and we can use (4) with m = 1/k. Alternatively, it is often more 
convenient to start from the formula 


i 


k 
felt’, 
A 


where |x'| is again a small proper fraction. This time 


(5) 


je 
A 


VA =e 2a + x, 


and we can use (4) with m = —1/k. 
Thus, for example, to sharpen the approximation 
V2 w 1.4, 
we write 
_ 1/2 
Va=14 JA a 14 fn OM 4 — 
1.96 1.96 49 
or 
— —1/2 
v2-—14. - A = 14(1- 3) 
/438 | _ 0.04 50 
V 2 2 
To keep the calculations simple, we naturally prefer the second 
formula, which leads to the rapidly convergent expansion 
V2=14f1 ,i 1 31 a 
2 50 8 50? 16 503 
35 1] 63 1 
+ — — + — oem (6) 
128 50* 256 505 


(see Problem 8). 
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PROBLEMS 


1. Prove that 


Hint. Choose x = 4, y = 4 in the formula 


x+y 
— xy’ 


arctan x + arctan y = arctan 


valid for 


bi 
jarctanx + arctan y| < > 
(explain this condition). 


2. Use formula (1) to calculate z to seven decimal places, mak- 
ing sure to take round-off error into account. 
Hint. It is enough to compute the terms already written out 


in (1). 
Ans. % = 3.1415926... 


3. Use formula (3) to calculate In 2 to nine decimal places. 
Hint. Nine terms of the series suffice. In fact, if d is the error 
due to dropping all terms from the tenth on, then 


2/1 1 1 1 
A= —f{— — + — — + = 
3 \19 99 21 91° 


2 1 1 
< ———/1+—+4+—~4+- 
3-19-99 9 9? 


1 2 
———. < — : 
12-19-98 10*° 


Ans. In 2 = 0.693147180... 
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4. Show that 
nse rmr2+o(is oo +o +e). (7) 


Hint. Set n = 4 in formula (2). 


5. Using (3) and (7), calculate 


1 
In 10 
to nine decimal places. 
Ans. M = 0.434294481... 
Comment. Note that? 
logn = Minn, 


so that M is the ratio of the common logarithm of any number to 
its natural logarithm. Thus, going over to common logarithms 
in (2) and (3), we get 


n+] 2M 
log = 
n 2n+ 1 
1 1 1 1 
x | 1 + ——— _ + — ———__ + =: 
3 (2n + 1)? 5 (2n + 1)* 
(2' 
and ) 
1 
log2 = 2 rgity tly... . (3’) 
3 3 9 5 9? 


6. Use formula (3’) to find log 3 and log 7. 
Hint. Choosen = 80 = 23-10, notingthatn + 1 = 81 = 3+, 
Then 
4log3 — 3log2 — 1 
2M 1 1 1 1 
= + — — —— +: ; 
161 3 25,921 5 25,921? 


3. As always, log = logig,Ina = log,z. 
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from which log 3 can easily be found (log 2 is already known). 
Next choose n = 2400 = 3-23: 10?, noting thatn + 1 = 2401 
= 7*. Then 


4log 7 — 3log2 — log3 — 2 
2M 1 1 1 1 
= —— (1+ — ——__ _ + ——_____}} ... J. 
4801 3 23,049,601 5 23,049,6012 


Comment. This technique can be used to find the common 
logarithms of the prime numbers to within any desired accuracy. 
Common logarithms of composite numbers can then be found 
by adding integral multiples of common multiples of prime num- 
bers. For example, 


log 120 = 3 log 2 + log3 + log 5. 


7. Prove that the error A of the approximation 


2 
log(n +1) —logn —@— ao? <n < 104) (8) 
2n+ 1 


is less than 4x 1071°. 
Hint. Let A be the error of the approximation (8). Then 


2M 1 1 1 1 
A= SS tt hv tt 
2n+1]3 (2n+ 1)? 5 (2n + 1)* 


2M 1 1 
< ———_ } 1 + ——__ +. —___}+ = 
3 (2n + 13° (2n + 1)? (2n + 1)* 
_ 2M 2M 
3(2n + 1)2n(2n +2) | 24n3 


Comment. Even if all the separate errors have the same sign, 
the use of (8) to calculate logarithms of the numbers 1000 to 
10,000 step by step would lead to a cumulative error of less than 

10+ 1 


=— xl10-§. 
2+ 101° 2 
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However, it is easy to avoid such accumulation of errors by using 
(2’) to calculate a number of “control logarithms.” In this way, 
we can achieve much higher accuracy while at the same time re- 
taining the automatic character of formula (8), a feature which is 
very valuable in compiling extensive tables. 


8. Use formula (6) to calculate V2 to ten decimal places. 
Hint. It is enough to compute the terms already written out in 
(6). If A is the error committed in dropping all subsequent terms, 


then 531 
A<14—3! (7,145,464... 
1024 - 50° 50 50? 


231 <2! 
1024-505-49 1011 © 


Ans. 2 = 1.4142135623... 
Comment. To get an even more accurate value of V2, we can 
Start from the formula 


J2 = Lai (1 119 _ 


20,000 
9. Verify that 


_ -1/2 _ 1/2 
¥3 =1.73({1 - JL vn a 28 (py, 
30,000 3 100 


1/3 _ 1/3 
ee ee 


ll 
Il 


125 


Use these formulas to get accurate approximations to the roots 
in question. 


13. Euler’s Transformation 


In using a series for approximate calculations, it is sometimes 
useful to subject it to a preliminary transformation. By this we 
mean the use of some rule or other to replace the given series by 
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another series with the same sum. Of course, making such a trans- 
formation is appropriate only when the new series converges 
more rapidly than the old series or is more suitable for calcula- 
tions. 

We now derive the formula for a classical transformation due 
to Euler. Let 


Six) = ¥ (—1F a,x 
k=0 
= Ay — A,X + agx? — + + (—1)F ayx* + 
(x > 0) qd) 


be a convergent series, where for convenience we write, the kth 
term in the form (—1)* a,x* without assuming that all the a, >0. 
For the sequence {a,} we introduce the successive differences 


Ady = Qy41 — An, A? ay = Aas, — Ady = Oy42 — 2An41 + Oe, 
and, in general, 
Ava, = A®~-ta,4, — A? ta, 

= Apap — Cidn+p-1 + Clay 4 p-2 —+++(-1)? a, (2) 
where C? is the binomial coefficient 


chan 2 
I'(p- 7)! 


We then write the series (1) in the form 


S(x) = ao _ ax — Agx 
1+x 1+x 
x? — a,x? x? — a,x} 
p B28 TN Ea ON pe (3) 


1+x l+x 
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This is permissible since the (k + 1)th partial sum of the new 
series differs from the Ath sum of (1) only by the term 


] 
l1+x 


(- 1)k*+ Ay kt 1 


which approaches zero as k — oo because of the convergence of 
the original series (Ruds., Theorem 5, p. 8). 
We now use the differences to simplify (3), obtaining 


S(x) = 


(ag — Ady x + Aa, x? — Aa,- x3 +++), 
x 


Retaining the first term, we write the remaining series 


x 


1+x 


(Ady — Aa, + x + Aa, - x? — -+) 


like S(x) itself in the form 


x ] 
1+x 1+x 


(Ady — A?aq- x + A?a, +x? — ++), 


so that, splitting off the first term again, we get 


S(x) _ ao Aap 


———- x 
1+x (1 + x)? 


x? 


4+ —* — (A2ay — A2ay x ++). 
(+x | ° ; 


Continuing in this way, we obtain 


2 
S(x) = 20 _ 4¢0 5 Alto _., 
1+x (1+ x) (1 + x)? 
p-l1 
+ (-1)7? AP tay xP-1 4 Rix) (4) 


(1 + x)? 
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after p steps, where 


Rx) = (—1)? xe (APay — A®a, +x + A?ag- x? — +) 
(1 + x) 
= (-1)? ———_ y, (—1)* A?a,x*, 


a x)? k — 


To prove that R,(x) > 0 as p > co, we replace the pth difference 
A?a, by its expression (2) and reverse the order of summation, 


obtaining 


R,(x) = = 


~ P 
(—1)¥t? x¥+2? S (-—1)! Clays p~i 
(1 +x? + x)? x dS ) 2 ) i“k+p 


is a 


Bp 
= ae ROME CDT aaae attr 


Denoting the remainder of the original series (1) by 
i+ o) 
7y(X) = YH 1) ay kt" (n = 0, 1, 2, ..)s 
k=0 


we can finally write R,(x) in the form 
y C?x'r,_ @) > Cix?~'r, (x) 
Ry) = = (1 + x) (l+xP ° 


and hence R,(x) > 0 as p— oo, by Problem 3, p.25, since 


r(x) > Oasn— oo. 
Taking the limit as p > oo in (4), we get 


2 
S(x) = | ay — Ady * + Aas ( * ) oe 
1+x 1+x 1+x 


x y + ~. (5) 


+ (-1)? A?ay ( 
1+ 
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Comparing (1) and (5), we finally obtain Euler’s transformation 
¥ (1k ax = a > (-1 Aa, (—2—)". 6) 
k=0 1+ x p=0 l+x 


Equation (6) is most frequently used with x = 1, and it then 
transforms one numerical series into another: 


— ~~ (—1)? Aa 
_1\k 
> (-Diae => (7) 
Example 1. Let 
n= 1 
\ z+k’ 


where z is any constant different from 0, —1, —2,... Then the 


series © (-1)k 


k=0 z+k 


is a series of the Leibniz type if we drop a sufficiently large num- 
ber of initial terms, and hence converges. The successive differ- 
ences Aa,, Aa,, ... are easily calculated. In fact, using mathe- 
matical induction, we find that 
! 
Ava, = (— 1)? ——_____?_— 
(zt+k)(z@+k4+1)--@+k +p) 

and, in particular, 
Pp! 


A®ay = (— 1)? ——__—_____. 8 
3 (“1) z(z+1)+-(z + p) ®) 

It follows from (7) and (8) that 
ee ee ee) 


0 z+k poo 2°42 7(z4 1) (z +p) 


Setting z = 1 in (9) leads to the following transformation of the 
familiar series for In 2: 


n2=Y(-ypt tay J 


m=1 m n=1 2" 
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The second series is obviously more suitable than the first for 
numerical calculations. In fact, to get an accuracy of 0.01 we 
need 99 terms of the first sequence and only 5 terms of the sec- 
ond! 
Example 2. Let 
1 


z+2k’ 


where zis a constant different from 0, ~2, —4, ... Representing 
a, in the form 


a= 1 1 
ko r) 
tuk 
2 
we can use formula (8) to write 
p! 
A ao = (-1)? 
2 $ (S41 w(24p 
2\2 2 
Ptlyt 
= =(-1pP— 1 ae Le (10) 
2 z(z + 2)-:-(z + 2p) 
Then Euler’s transformation (7) takes the form 
= 1 1S ! 
¥ (-1 =~) . (a) 


k=0 z+ 2k 2 p=0 z(z + 2)--- (z + 2p) 


Setting z = 1 in (11) leads to the following transformation of the 
familiar series for 2/4 (Ruds., p. 115): 


» 


z_y —1)k oe 
4 d,{ "3 0 2p + 1)(Qp — 1-3-1 


1 

k+1 ~ 9 
Example 3. In calculations using a transformation of a series, 

it is often convenient to first calculate some terms of the series 
directly and afterwards subject only the remainder of the series 
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to the transformation. As an illustration, suppose we calculate x 
by using the series 


| 1-2 1:2:°3 
m=2(1+—+——+ toe 
3 3 7 


5 
1-2- 
12 

panGeept” ), 02) 


derived in the preceding example. Since the ratio of the last 
written term to the preceding term is 


1 

P <—, 

2p + 1 2 

the discarded remainder of the series is always less than the pre- 


ceding calculated term. For example, we get a to six decimal 
places by calculating 21 terms of the series (12), since 


1-2-3-+-20 
1°3-5-+4] 


= 0.00000037... < 0.0000005. 


However, if we calculate the first 7 terms, say, of the original 
series directly and transform only the remainder after 7 terms, 


we get 
a-4(i-t443_-4,4 4,4 
3 5 7 9 1] 13 
(1 1, 2 
*\15 15-17 15-17-19 


1-2 
hr ed, 
15+17+-- (15 + 2p) 
The eighth term of the transformed series is now within the 
required limits, since 


7 1-2-3-4-5-6-7 
15-17-+- 29 


= 0.0000002... 
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Hence to get the same accuracy as before, we must now only 
calculate 8 more terms besides the 7 retained terms, i.e. only 
15 terms in all as opposed to the previous 21 terms! 


PROBLEMS 
1. Prove that 
arctanx = y (- a rer 
k=0 2k + 1 


x = 2p (2p — 2)---4-+2 x? \P 
1 + x? p=o (2p + 1)(2p — 1) 3-1 \1 4+ x? 


(0<x <1) 
(cf. Ruds., p. 115). 
Hint. Choose a, = 1/(2k + 1) in (6), using (10) with z = 1 to 
calculate A?a,. 


2. Give examples showing that subjecting a convergent series 
to Euler’s transformation does not always improve its rate of 
convergence. 

Comment. In comparing the rate of convergence of two series 


with terms of arbitrary sign, we start from the behavior of the 
Tatio of the corresponding remainders y, and y,, i.e., if 
lvalval 2 O asn — oo, we Say that the first series converges more 
rapidly than the second and the second more slowly than the first 
(cf. Ruds., Definition 1, p. 53). 

Ans. The series 


1 
XD oe 
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is transformed into the more rapidly convergent series 
while the series 


is transformed into the more slowly convergent series 
y 1/3\? 
r=0 2\ 4) - 


14, The Transformations of Kummer and Markoy 


We have just seen how Euler’s transformation, based on a 
well-defined rule, leads to a unique transformed series, which, 
however, is not always suitable for computational purposes (see 
Problem2 above). We now describe a method of transforming 
series due to Kummer which has a high degree of built-in arbitra- 
riness (requiring much ingenuity on the part of the calculator), 
but which in return is more specifically directed to the goal of 
simplifying the given calculation. 

Thus let 

AG) 4 A@ ac. 4 AM 4, (1) 


be a convergent series, and suppose we want to calculate the sum 
of (1) to a given accuracy. Clearly A™ — 0 as k > oo. Suppose 
we find another series 


1) (2) (k) 
a? + af 


ter tap tes (2) 


converging to an easily calculable finite sum A, such that the 


general terms A“ and a“ of the series (1) and (2) are equivalent, 


indicated by writing A™ ~ a‘ (as k + o), in the sense that 


lim —— =0, (3) 
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where 
k k 
a) = Ate) — at (4) 


Formula (3) is usually written more concisely as 


as? = of A), (5) 
Note that (5) implies 
a = ofa”) 
as well, since 
(k) 
Oy 
(k) (k) rt) 
. x . A 
lim —5 1 = lim a = 0 
kaw @, k-+00 AW x k-+00 Oy 
A® 
It follows from (4) that 
wo a foo) a 
y AM = > a + ¥ oP =A, + ¥ af. (6) 
k=1 k=1 k=1 k=1 


Thus we have reduced the calculation of the sum of the original 
series (1) to that of the sum of a transformed series whose terms 
certainly approach zero more rapidly than A“, because of (5). 
Example. To calculate the sum of the series 
y 1 
1k?” 


k 


we recall that 
518, 
k=1 k(k 4+ 1) 
(Ruds., Prob.2, p. 4). Since 


1 1 1 


2 bike Duka 
tim KEE AD _ pe MTD 


k-+00 1 k> 0 


0, 
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it follows from (6) that 
= 1 


yta1+ yt. (7) 


k=1 k? k=1 k* (kK + 1) 


where the transformed series is clearly more suitable for cal- 
culation than the original series. 

Repeating the same process, suppose we can find still another 
series 


(k) 


ay» tee + af 


(2) 


+ a3 +e 


converging to an easily calculable finite sum A, such that a{” is 
equivalent to «{” in the indicated sense. Then 


SAM aA tA + Dah, 


so that the calculation of the sum of the original series (1) reduces 
to that of the sum of a series whose terms 


(k) (k) (k) 


aS? = « — al? = o(aS”) 


converge to zero more rapidly than «“’, Similarly, repeating the 
process p times, we arrive at the formula 


y AM = A, + Ante + Ant x ol, (8) 
k=1 
where 


=> a = (j = 1,2,...,p) 


are known sums of series which are successively “split off” from 
the original series, so that the problem reduces to calculating the 
sum of the series in the right-hand side of (8). 

Next we discuss another method, due to Markov, for trans- 
forming a given convergent series 


Ae =A =A. (9) 
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Like Kummer’s method, this method also has much built-in 
arbitrariness. 

Suppose every term of (9) can be represented as the sum of a 
convergent series 


A®=Sa® (k= 1,2,...), (10) 
J=1 


and consider the infinite rectangular matrix 


‘e) 1 1 1 

AW as as 2 QQ... a‘ . 
2 2 2 2 

Ao) a a aS... ab yi. 
3 3 3 (3) 

A® | a a a af? +. 
k (k) (k) (kk) (k) 

Aw&®*) QA, Ay A308 Gp 


made up of the terms of the series (10). Then the number 4 is 
just the sum of the iterated series 


Loo] fos) 
A=) ya 
k=1f=1 


corresponding to this matrix. Assuming that every column of the 
matrix gives a convergent series 


fo a) 
(k) 
» a; = A;, 
k=1 


Markov established a necessary and sufficient condition for the 
Series 


14 
J=1 


to converge to the same sum A. Correspondingly, Markov’s 
'ransformation consists in replacing the original iterated series 


§ Fichtenholz (2094) 
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(summed over rows) by the other iterated series (summed over 


columns): w 


A= YAM = YAY 
if 


k=1 


A sufficient condition for applying Markov’s transformation is 
given by Theorem 3, p. 34, say. However, the theorem proved 
by Markov is much more general, and does not even assume the 
absolute convergence of the series involved. 


PROBLEMS 


1. Prove that «, ~ B, (as k > oo) if and only if 


lim * =. 
kao By 
2. Show that 
ees or 
k=1 k? 2? k=1 k? (kK + 1) (k + 2) 
1 1 ~ 1 
es ee ea | 
k=1 k? 2? 3? k=1 k? (Kk + 1) (k + 2)(K + 3) 


and more generally, that 


an | 1 1 1 
—=14+— 46-4 — p! > ——— 
k=1 k? 2? po koi k? (kK + 1)++- (kK + p) 
(12) 
Hint. Starting from (7), use (8) and the formula 
“ 1 1 


ar +1) (k +p) pp! 
(Ruds., Prob. 2, p. 4). 


Comment. Thus the calculation of the sum of the slowly 
converging series 


iMs 


a 
1k? 
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is reduced to the calculation of the sum of p of its terms and the 
sum of a transformed series which converges rapidly (even for 


moderate values of p). 


3. Show that 

bea ! 
Ft i3(h, 11, 41 2! 
a1 k? 2 2:223  3-235+3-1 

_ (p — 1)! 

p: 2? (2p — 1) (2p — 3) + 3-1 

+ (p!)? 

2? (2p — 1) (2p — 3)+:-3-1 
(13) 


* 2B (k + 1)? (k +p)? 


Hint. Since 
1 k+y 
2p — 1Lk*(k + 1)? (kK + p — 1)? 
_ kK+1+y 
(kK + 1)? (K + 2)? ++; (k + p)? 


_ i (2p — 1) k? + p(p + 2y)k + yp? 

~ 2p — lees 1)? -- (kK +p— a | 
1 

~ 2k + DP (kK + p — 1) 


as k — o, where y is temporarily undetermined, it follows from 


(6) that 
s,= y ———_}_ 1 iI+y 
kik? (k +1)? (kK +p—1)? 2p—1 (p!)? 
p yp 
2p — + 2y)}k+ | p? — —— 
E ai” »| E | 


k2 (k + 1)? + (k + p)? 
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Now choose 3 
)/p 
9 an 3 
2 


thereby causing the term containing k to vanish in the numerator 
of the series on the right. With this choice of p, 


3 3 
pea PS, 
2(@2p —1)(p!)?—_2(2p — 1) 

Therefore 
2] 3 I 
— =S,;=—+—S,, 
ne , 2 2 , 
1 3 
1g 3 1, OP 5 
2 2-223 22-31 
(ep — 1)!P 
2°-1 (2p — 3)(2p — 5) 3-1 ” 
_ 3 (p — 1)! 
p: 2? (2p — 1) (2p — 3) + 3° 1 
(p!)° 


Sptis 


2? (2p — 1) (2p — 3)---3-1 
which together imply (13). 


4. Suppose we choose p = 5 in (13) and also retain 5 terms of 
the transformed series. What is the accuracy of the resulting cal- 
culation of the sum of the original series? 


5. Interpret Example 3, p.44 as an instance of Markov’s 
transformation, discussing the results of using the two represen- 
tations 


lo a] 

a (k) 
7 » a; , 

j=1 


ik i) 
+ ag? +e + ayy + Te, 


Computations Involving Series 85 


where 
pe a) 
J+ 1) G+ hk) 


Comment. As already noted on p. 45, Markov’s transforma- 
tion gives nothing new if we use the second representation. 


6. Show the connection between Kummer’s transformation 
and Markov’s transformation. 
Hint. Take the limit as p > oo in formula (8), assuming that 


lim x ay = 0. (14) 
pon 


7. Verify that (14) holds in the case of the expansion (13), 
thereby proving that 


ee) ee 

k= k? 2 2:22 3-235-3-1 
1 (p — 1)! on 
p- 2? (2p — 1) (2p — 3)-:- 3 
| (p -— 1)! 


a 15 
op? pod Opa3)n3 (19) 


Hint. The sum in the last term in the right-hand side of (13) 
does not exceed 
1 =f 1 


yy 


(pl)? 1k?’ 


and hence the whole term does not exceed the quantity 
p} . 
Opn NOp odd Ti 

2? (2p — 1) (2p — 3) ++ 3-1 = 


which obviously approaches zero as p > ©. 
Comment. Note that (15) is equivalent to formula (5), p. 46. 


1 
1k? 
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8. Give an example showing that taking the limit (14) does not 
always lead to a useful result. 

Hint. Taking the limit as p > oo in (12) merely gives the iden- 
tity 


Comment. Thus Markov’s method is a very general technique 
offering the calculator many possibilities but requiring much 
ingenuity on his part. 


CHAPTER 4 


Summation of Divergent Series 


15. Introduction 


So far, we have defined the sum A of a given numerical series 


oO 
yy Gn = Go + ay + Gn to + Oy to (1) 


au=Q 
as the limit 
A= iim A, (2) 


m+ 


of its partial sums 
A, = Ag + ay +, ++ + ay, 


assuming that this limit exists and is finite or equal to +00. On 
the other hand, the sum of an “oscillating” divergent series, for 
which the limit (2) fails to exist, has not been defined, and we 
have systematically avoided such series. In the second half of 
the nineteenth century, however, consideration of various situa- 
tions encountered in mathematical analysis, such as the fact that 
the product of two convergent series can diverge (see Example 1, 
p. 27), naturally brought to the fore the problem of trying to 
Sum divergent series in some appropriate new sense, perforce 
different from the usual sense associated with formula (2). 
Certain of these ‘‘summation” methods (to be studied in detail 
below) turned out to be particularly fruitful. 

It should be pointed out that divergent series were quite often 
encountered in mathematical practice prior to the creation by 
Cauchy of a rigorous theory of infinite series, based in turn on a 


87 
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rigorous theory of limits. Although the use of divergent series in 
proofs was disputed, nevertheless attempts were sometimes made 
to assign numerical values to such series. For example, the num- 
ber 4 was assigned to the oscillating series 


1-141-141-14-: 


even in Leibniz’s time, a choice which Euler justified by observ- 
ing that the expansion 


l =1]—x4+x?— x34 xt-— x54: 
1+x 
(which is actually valid only for |x| < 1) becomes 
1 


—=1-141-141-14= 
2 


if x is formally set equal to 1. There was a kernel of truth in this 
observation, but the whole approach lacked clarity. For example 
one could equally well deduce the formula 


Sr inlein14l-it 


by setting x = 1 in the expansion 


1+x 1 — x? 
—t* = = 1— x7 4 x3 — x5 + x8 — x8 4 ee, 
1+x+x? 1-x3 


The whole problem is posed differently in modern analysis. 
The starting point of all discussion is some precisely stated de- 
finition of the “‘generalized sum” of a series, which is applicable 
to a whole class of numerical series rather than being contrived 
for a particular series of interest at the moment. The legitimacy 
of this approach cannot be contested. The reader need only re- 
cal] that even the ordinary concept of the “sum of a series,” 
as simple and natural as it may seem, was introduced on the 
basis of a tentative definition, subsequently justified only by its 
expediency! However, regardless of how such a “generalized 
sum”’ is defined, it is usually required to satisfy the following two 
conditions: 
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1) If the series 


ye 


is assigned the generalized sum B, then the series 


ice] 

d (pa, + gby)s 

n=1 
where p and gq are arbitrary constants, must be assigned the 
generalized sum pA + gB. A method of summation satisfying 
this condition is said to be /inear. 


2) The new definition of summation must include the ordinary 
definition as a special case. More exactly, a series which con- 
verges to the sum A in the ordinary sense must have a general- 
ized sum, and this sum must also equal A. A method of summa- 
tion satisfying this condition is said to be regular. 


Naturally, we are only interested in regular methods of sum- 
mation which allow us to sum a larger class of series than can be 
summed by the ordinary method of summation, since only in 
this case does it actually make sense to talk about ‘generalized 
summation.” 

The next few sections are devoted to two methods of gener- 
alized summation of particular importance in the applications. 


PROBLEM 


Justify writing 
m 


~sl-1l¢1]—-14+1—-1l4tes, 
n 


where m and n are arbitrary positive integers. 


90 Infinite Series: Ramifications 


Hint. Note that 


Ltxtertxmt 1 -— x™ 
Ltxte¢xeto lox 


16. The Method of Power Series 


First we consider the method of power series, primarily due to 
Poisson who applied it to the study of trigonometric series. 
DEFINITION. Given a numerical series 


wo 
Yan = Go +a, +a, +--+ 4,4", 


2 
Ut 
o 


suppose the associated power series 


fo a) 


Y. agX" = Ag + A,X + agx? + + + gx + 


n=0 


converges for all0 < x < 1 toa sum function f(x), and suppose 
that 


lim f(x) = A. 


x71- 


Then the number A is called the generalized sum (in the sense of 
Poisson) of the given series. 
Example 1. As already noted on p. 88, the series 


1-1+1-14+1-14-. 


has the generalized sum 4 in the sense of Poisson, since 


l—-xt+x?—-x4x4-x5 4-05 
1+x 
and 
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Example 2. Use the method of power series to sum the diver- 
gent series 


st ¥ cos nO (-2 <6 <x) (1) 
1 


(see Problem 1). 
Solution. Form the power series 


too} 


1 
> th, 2 ood (0<x <1), 
n=1 
whose sum is easily seen to be! 
1 1 — x? 
— (2) 
2 1—2xcos@+x 
But 
1 1 — x? 


in — ———_——_ 
x+1- 2 1 — 2xcos@ + x? 


if 0 4 0. Hence the generalized sum of the series (1) equals 0 if 
6 # 0. If 6 = 0, (2) reduces to 


2(1-x? 21+x 


which approaches + oo as x > 1 —. Hence (1) has the generalized 
sum +o if 6 = 0. Note that (1) obviously has the ordinary sum 
+oif@=0. 

It is immediately clear that the present method of generalized 
summation is linear. Its regularity is a consequence of the follow- 


1. In fact, multiplying 
1+ 2 > x"cosné 


neal 


by 1 — 2x cos 6 + x? and noting that 
2 cos nx cos x = cos(m + 1) x + cos (n ~ 1) x, 


we get 1 — x? after cancelling terms. 
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ing theorem, proved by Abel in his investigations on the theory 
of the binomial series. Accordingly, the method of power series 
will henceforth be called the Poisson—Abel method (of summa- 
tion).? 

THEOREM 1 (Abel). /f the series 


IMs 
£ 


converges to A (in the ordinary sense}, then the power series 


Y ayx" (3) 


converges for 0 < x < 1 and its sum approaches Aas x71 -. 

Proof. First we note that the radius of convergence of the 
series (3) is no less than 1 (Ruds., p. 68), and hence (1) actually 
converges for 0 < x < 1. Consider the identity 


Y; a,x" = (1 — x) 5 A, x", (4) 
where - 


A, =a +a,+...+ 4, 


(see Prob. 3, p. 83 or Ruds., Prob. 1, p. 85). Subtracting (4) term 
by term from the obvious identity 


A=(1—x) ¥ Ax’, 
n=0 
we get 


A- a,x" = (1 — x) y Xx", (5) 


2. There is no doubt that the general formulation of the method of power 
series, used by Poisson only in a special case, stems from Abel’s theorem. 
The Poisson-Abel method is often simply called Abel’s method, although 
Abel himself regarded the idea of “summing” a divergent series as very 
much of an oddity. 
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where «, = A — A,. Since «, > 0 asn— oO, given any € > 0, 
we can find an integer N > 0 such that |a«,| < efor alln > N. 
The right-hand side of (5) is the sum of the two expressions 


Q=) Sax, C-) Dm © 
n=O n=N41 


the second of which can be estimated at once (independently 
of x): 


ass 


<(1-— x) } lanl x 
n=N+1 


feo) 
Y O_x" 
n=N+1 


<e(1 — x) y x" <e. (7) 


As for the first of the expressions (6), it approaches zero as 
x > 1—, and hence 


a — x) , XxX") <E (8) 


for x sufficiently near 1. Combining (7) and (8), we finally get 


A— > a,x" 
1 


<2. Of 


We have already seen that even if the series 


(9) 


iMs 
t=} 
a 


is Poisson—Abel summable with sum A, it need not have a sum 
in the ordinary sense. In other words, the existence of the limit 


lim ) a,x" =A (10) 
x7+1— n=0 
does not in general imply the convergence of (9). The question 
naturally arises of what extra conditions must be imposed on the 
terms of (9) to make (10) imply the convergence of (9), so that 
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(9) has the sum A in the ordinary sense. The first result along 
these lines is the following theorem due to Tauber: 
THEOREM 2 (Tauber). Suppose the series 


fe 6] 
Y ayx" 
n=0 
converges forO < x < 1 and satisfies (10). Moreover, suppose the 
terms of the series (9) are such that 
. ay + 2a, +++ + na, 
lim ———_——_____~ 


n7o n 


= 0. qd) 
Then 


Proof. The proof will be carried out in two steps. First we 
assume that? 
lim na, = 0, (12) 


nao 


or equivalently 


Thus if 


6, = max |ka,l, 
k>n 


then 6, decreases monotonically to zero as n — oo. Given any 
integer N > 0, we have 


Yq —-A=Sa(l—x)— ans + (5 aa — 4), 


n=NH41 n=0 
and hence 
N oO oo) 
x mAs » |na,| (1 — xt d rele +/> ays A| 
n=0 =N+ n=0 
cacons ey Y. a,x" — | 
(V+1)\Q—-x) |x=0 


3. Note that (12) implies (11), by Corollary 2, p. 23, but not conversely, 
so that we are first proving the theorem under astronger hypothesis than (11). 
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where we use the inequalities 


l-x =(l-xyUt+xtx7 45-427) <n(1 — ), 


a xNt1 1 


n=N+1 l1-—-x 1-x 
valid for 0 < x < 1. Choosing e > Oarbitrarily small, we set 
(l-—xN=e, 


or equivalently 


x=1-—, 


so that x > 1 as N— oo. Now let N be so large that dy4, < & 
and the corresponding value of x is close enough to 1 to make 


boo] 


Y a,x" — A 
i?) 


<€é, 


Then 
N 
Yd a, -4/<@+ bo) E; 


n=0 


which, because of the arbitrariness of Nand e, proves the theor- 
em under the hypothesis (12). 

We now reduce the more general case of the theorem to the 
special case just considered. Let 


vo = 0, 
V_ = A, + Zag + + + Na, (n > 1), 
so that 


a,=+(y%— m1) M21) 
n 


and hence 


ra) © oy 
Yo ax*=ao+ ¥ 2x - yy Hew 
n=0 n=1 Nn a=1 n 


boo] Un 


» n(n + 1) me @3) 


ap + (1 — x) Yat + 
n=1 
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This time we have (11) or, equivalently, v,/n + 0 asn— o. It 

follows that , 

lim (1 — x) Y x" =0. (14) 
n=1 Hh 


x741- 


To see this, we write 


oo N . oc 
G-»)Y @ewa-)Y 2x 40-9 Y =x, 
n=1 Hh n=1 hh n=oN+1 MN 
and then choose N so large that all the factors v,/n in the second 
expression on the right have absolute values less than some 
preassigned number e > 0. Then the second expression is itself 
less than é€, regardless of x. Moreover, the first expression on the 
right, which contains only a finite number of terms, can also be 
made less than ¢, by simply choosing x close enough to 1. 
Thus, finally, combining (10), (13) and (14), we get 


. — vu 
lim —2*— x*1 = 4- aay. 
x1 2 n (n + 1) ° 


But here we can apply the already proved special case of the 
theorem, obtaining 


i.e) Un 


Y el A — ag. 

n=1n(n + 1) 
On the other hand, we have 

Up et y Ur we tne Unt 
n=itn(nt+ 1) vei 41 a=in+1 nai 4n m1 oN 
Un nm 
=— + ¥ a, 
m+i n=1 


Since the first term on the right approaches zero as m > ©, it 
follows that 


lim }a,=A-—ao. Hi 


m+oo n=1 
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Remark. Subsequently, various authors have proved a whole 
series of delicate theorems of the same type (customarily called 
“Tauberian theorems’), modifying and extending Tauber’s con- 
ditions. 


PROBLEMS 
i. Show that the series 


iy > cos nO 
2 n=1 
diverges for all 6 in the interval [—2, x]. 

Hint. If 6/2 is a rational number, i.e., of the form p/g where p 
and q > O are integers, then cosn@ = +1 for values of n which 
are multiples of g. This violates the necessary condition for con- 
vergence of a series (Ruds., Theorem 5, p.8). If the ratio 6/2 
is irrational, then, expanding 6/7 as an infinite continued frac- 
tion, we find that* 


for appropriate rational numbers m/n, and hence 
1 
|n6 — mn] < —. 
n 
Therefore, for infinitely many values of n, we have 


Kf4 
jcosn8 + I] < —, 
n 


so that 


rid 
|cosn6| > 1 — —, 
n 


which again violates the necessary condition for convergence. 


4. See A. Y.Khinchin, Continued Fractions, third edition, University of 
Chicago Press (1964), p.17. 


7 Fichtenholz (2094) 
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2. Find the generalized sum A(6) in the sense of Poisson of the 


series 
oO 


sinné (-x <0 <7z). (15) 
n=1 
Hint. 
> x"sinn@ = __xsind 
n= 1 — 2x sin 8 + x? 
Ans 
[° if @=0, 
A(8) = 1 7] 


cot— if 640. 
2 2 


3. Show that the series (15) diverges for all 6 in the interval 
{—x, 2] except 6 = 0, +x. 


17. The Method of Arithmetic Means 


Next we consider the method of arithmetic means. This method 
of generalized summation, the idea of which is due to Frobenius 
in its simplest form, is usually associated with the name of 
Cesaro who developed the method further. 

DEFINITION. Let 
tip = Ao, a, fot 4 gy a fot dr tte 


2 n 
be the successive arithmetic means of the partial sums 
A, =A, +a, +--+ +4, (n = 0, 1, 2,...) 


of a given numerical series 


oo) 
Y Q,=Ag ta, ++: +4, + "5, 
n=O 
and suppose that 
lim «, = A. 


n->00 
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Then the number A is called the generalized sum (in the sense of 
Cesaro) of the given series. 
Example 1, In the case of the series 


1-l+4+1l—-1l4+1-14-5, 
we have 
_k+i 
2k +1? 


Oar ®2n-1 


1 
- 
Hence «, > 4 as n— oo, and we get the same sum as by the 
Poisson—Abel method (Example 1, p. 90). 
Example 2. The series 


cos nO (-xz <6<2) (1) 
1 


1 Lo of 
— + 
2 ac 


has partial sums 1 
sin ¢ + ;) 6 
A, = ————— (6 # 0) 


2 sin — 
2 


(see Ruds., formula (8), p. 82). The arithmetic means are easily 
calculated. In fact, 


(n+ 1l)«, = — Y sin(ms ayo 


_ i > [cos mf — cos(m + 1) 6] 


4 sin? — 
2 


6 2 
sin (n + 1) — 
1—cos(n+1)0_ 1 2 


4 sin? : z sin 4 
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and hence 
2 


0 
sin (n + 1) — 
( 5 


int 1 
(n + 1) sin — 


Obviously «, > 0 as n > oo, so that the generalized sum of the 
series (1) in the sense of Cesdro equals 0 if 0 4 0. Thus we get 
the same result as obtained by the Poisson-Abel method 
(Example 2, p. 91). This is no coincidence, as will be shown in 
a moment (see Theorem 1 below). 

The fact that the method of summation by arithmetic means 
(Cesaro’s method) is linear is obvious from the definition. More- 
over, if the limit 

lim A, 


exists and equals A, then 


lim «, = A 
as well, by Corollary 2, p. 23. It follows that Cesdro’s method is 
also regular. 
LemMa. If the series 


Ms 
a 
a 


is summable by the method of arithmetic means to a finite “‘sum” 
A, then 


a, = o(n). 
Proof. Since 
1 
&m-1 27 A, + X, > A 
n 


asn— oo, we have 


(n + 1)a&,— NO; An 


n n 
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and hence 
ay _ An N=1TAn-1 1G 
n n naur-—!l 
asno ow. & 

We can now give a definitive answer to the question of the 
connection between the Poisson—Abel method of summation and 
Cesaro’s method: 

THEOREM | (Frobenius). Jf the series 


a 
> On 
n=0 


is summable by the method of arithmetic means to a finite ‘“sum” 
A, then it is also summable by the Poisson-Abel method to the 
same sum A. 

Proof. By hypothesis, «, + Aasn-— oo. Then the power series 


fx) = Ya 


clearly converges for 0 <x <1, by the lemma. Applying 
Abel’s transformation twice (as in Prob.3, p.17 or Ruds., 
Prob. 1, p. 85), we get 


f(x) =(1 - x) 2 An” == (1 — x)? d(n + Dax" (2) 
But, as is easily verified, 


I a 
Go»? =, = 2, +1)x 


or 
00 


1=(1 — x)? > (m+ I) (3) 


for 0 < x < 1. Multiplying both sides of (3) by A and then 
Subtracting (2) term by term from the resulting identity, we get 


A—f(x) = (1 — x)? Y + 1) (A — o%) x”. 
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The right-hand side is the sum of the two expressions 


Qa Dint D(d—aa, a? + Aa) at 
(4) 


Let N be so large that |A — o,| < ¢ for alln > N, where ¢ is 
any preassigned positive number. Then the second of the ex- 
pressions (4) is itself less than ¢ is absolute value (independently 
of x), while the first expression can also be made less than « is 
absolute value by simply choosing x close enough to 1.5 

Thus we have shown that whenever Cesaro’s method is ap- 
plicable, the Poisson—Abel method is also applicable and leads 
to the same generalized sum. The converse is not true, i.e., there 
exist series summable by the Poisson—Abel method but not by 
Cesaro’s method. For example, the series 


1-24+3-4+4-+. (5) 


cannot be summed by Cesaro’s method, since the necessary con- 
dition a, = o(n) proved in the lemma obviously fails. On the 
other hand, the power series 


1 ~— 2x + 3x? — 4x3 4 =. (0<x <1) 


has the sum ' 


(1 + x)? 


which approaches 1 as x > 1~—, so that (5) is summable to 4 by 
the Poisson~Abel method. Thus the Poisson-Abel method is 
more powerful (i.e., applicable to a larger class of series) than 
Cesaro’s method, but leads to the same result as Cesaro’s 
method whenever both methods are applicable. 

Just as in the case of the Poisson—Abel method, we can prove 
theorems of a “Tauberian”’ type for Cesaro’s method, establish- 


5. Note the resemblance between the proof of this theorem and Theo- 
rem 1, p. 92. 
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ing extra conditions on the terms of a series under which the 
summation of the series by Cesaro’s method implies its conver- 
gence in the ordinary sense. Because of Frobenius’ theorem, it is 
clear that every Tauberian theorem for the Poisson—Abel method 
leads to an analogous theorem for Cesdro’s method. For exam- 
ple, Tauber’s theorem itself (Theorem 2, p.94) can be para- 
phrased as follows: If, — A and 

lim a, + 2a, + +++ + na, 
no n 


= 0, (6) 


then A, —> A. Here, however, the theorem is an immediate con- 
sequence of the easily verified identity® 


Q, + 2a, + +++ + na, 
A, — & = ———_—_—_,, 
n+ 1 
which in the present case even implies the necessity of (6). 
It was proved by Hardy that «, -» A implies A, -» A not only 
if @, = o (1/n) (this case is contained in the foregoing) but also 
under the weaker assumption that 


|ma,,| < C (m = 1,2,...) (7) 


for some constant C > 0. Then Landau showed that (7) can 
even be replaced by the corresponding “one-sided” inequality: 
THEOREM 2 (Hardy—Landau). /f the series 


don 
n=0 
is summable to A by the method of arithmetic means and if 
may, > —C (m = 1, 2,...) 
6. Note that 
(a + 1) Ag — (2 + 1) &q = (n + 1) A, — (Ag + Ar +71 + An) 
= (A, — Ag) + (A, _ A1) beet (A, _ An-1) 
= (a, +a, t+: +4@,) + (a, +" +.) 


+ aoe + ay 
=a, + 2ag + °°" + May. 
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for some constant C > 0, then’ 


Via, = A. 
n=O 
Proof. First consider the sum 


n+k 


S= ¥ An, 


m=n+1 


where n and kK are arbitrary positive integers. This sum is easily 
transformed into 


at+k 


S 


i 
M 


m=0 


An — > An = (n +k + \)oqs4y~ — (n + 1) oy 
m=0 


= Kons k + (n + 1) (On4+x 


~~ Xn). (8) 
It follows from the hypothesis 
Cc 
an > -— 
m 


that any 4,, (with n <m <n + k) has the following lower 
bound: 


k 
Am = An + (Gna. + 0° + Gy) > Ap- —C 


Then, summing over m, we find that 


2 
s>ka,~ “ce. 
n 


7. Changing the sign of all the terms of the series, we see that it is also 
sufficient to assume the opposite inequality 


ma, < C (m = 1,2,...). 


In particular, the theorem is obviously applicable to all series with terms of 
constant sign. 
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Comparing this with (8), we find that 


nt+1 


Am < +n + k 


(nin —- om) + He. (9) 
n 


Now let n approach infinity while at the same time k is subject to 
the requirement that the ratio k/n approach a preassigned posi- 
tive number e. Then the right-hand side of (9) approaches the 
limit A + eC, so that 


A, < A + 2eC (10) 


for all sufficiently large n. 
In just the same way, by considering the sum 


So= Yo An = kotn_, + (2 + 1) (On — One) 


m=n—-k+t1 


and deducing the upper bound 


Am = An — (m+ tose + a.) < A, + 


for A,,, we arrive at the inequality 


2 


S’ < kA, + 


It follows that 


n+ 1 k 


A, > O-_% + (a, — %,-,) — ——- C. (11) 
n—k 


Ifn > oo and at the same time k/n > «, then as before (but this 
time lete < 4), the right-hand side of (11) approaches the limit 


A- E 


C>A— 2eC, 


— E 
so that 
A, > A — 2eC (12) 
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for all sufficiently large n. Comparing (10) and (12), we finally 
get 
lim 4,= A. [i 
Remark. A similar Tauberian theorem has since been proved 
for Poisson—Abel summation, with the Hardy-Landau theorem 
as a Special case. Because of the complexity of its proof, this 
more general theorem will not be given here. 


PROBLEMS 


i. Use the method of arithmetic means to sum the series 
Lee) 


sin nO (-x <0 <2). 
=1 


Compare the result with Problem 2, p. 98. 
Hint, Since 


6 1 
cos —cos(n +3) 0 
A, = (0 # 0). 


2 sin — 
2 


(see Ruds., formula (7), p. 8), we have 


7] 
(n+ 1), = 7+ cot = - lO x 
4 sin? — 
2 
n+i1 


x } [sin(m + 1) 6 — sin m6] 
m=1 


n+] 6 sin (n + 2) @ — sin 6 
cot — ~ ———__—_—_——__. 
2 2° 


., 9 
4 sin? — 
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It follows that 


1 6 
lim «, = — cot — 6#0). 
lim % = > 5 ( ) 
2. Prove formula (2) directly. 

Ans. 


(1 — 2x + x?) y (n + 1) o,x" 


=) [(n + l) a, — 2no,~, + (n — 1)0,_2] x" 


=) {[(n + 1) &, — NA, it — [N&_—1 _ (n ~ 1) n—2]} x" 


= 2G — A,. yx = Y a,x", 


n=0 


8 


where the series on the left converges by the boundedness of the 
&, and we set x, = *_2 = A_, = O (the convergence of the 
last series is automatic here). 


3. Let {a,} be a positive sequence decreasing monotonically 
to zero, and let 


Ao = ao; A,= QA, +a, +°" +4, (n > 0). 
Prove that the alternating series 
Ag — Ay + A,—-—A3+-° (13) 


is summable by Cesaro’s method and that its generalized sum 
equals one half the sum « of the convergent series 


Gg — 4; + 2 -— a3 + 


of the Leibniz type. 
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Hint. The arithmetic mean of the first 2m partial sums of (13) 
can be written in the form 
1 (dg — 1) +++ + (Go — G1 ++** + Qam— 2 Fam—1) 


2 m 


and hence approaches 4« by Corollary 2, p. 23. Show that the 
arithmetic mean of the first 2m + 1 partial sums of (13) ap- 
proaches the same limit. 


4, Show that the divergent series 


where ; 
A,=1l+—4+:-4-, 
2 


is summable by Cesaro’s method to 4 In 2. 
Hint. Use the preceding problem with 


(n = 0,1, 2,...). 


a, = 
" nt] 


5. Show that the divergent series 
In2 —1n3 + In4 —In54+ 


is summable by Cesaro’s method to 4 In (7/2). 
Hint. Use Problem 3 with 


n+2 
n+] 


a, = In 


recalling Wallis’ product (Ruds., Prob.1, p. 91). 


6. Use Problem 3 to prove that the divergent Dirichlet series 


y (—1)""? = y (=n 


n* 
(-l<x<0, §=~-x,0<€< 1) 


(cf. Ruds., Example 2, p. 82) is summable by Cesaro’s method. 
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Hint. Writing n® as the sum 
ni = (1-0) + (2-1 +--+ (nf — (2 — 194), 


use differentiation to show that f(n) =n* —(n—1)* is a 
decreasing function of n. Then show that f(n) > Oasn— a, 


7. Consider the series 
1-1+1)-14+1-14-5, (14) 
1-1+0+4+1-14+40+4+1-—-140+-., (15) 
O+1-1404+14+0+4+0+40-14+-:., (16) 


where (15) differs from (14) by having a zero after every pair of 
terms +1 — 1, while (16) differs from (14) in that the term +1 
in the mth position (m = 0, 1, 2,...) is moved to the 2th posi- 
tion with the remaining positions being filled by zeros. As we 
already know, (14) is summable by Cesaro’s method to 4. Show 
that (15) is summable by Cesaro’s method to 4, while (16) fails 
to be summable by Cesaro’s method. 

Hint. In the case of the series (16), as n goes from 2?"~1 to 
2?" — |, the arithmetic mean of the first n + 1 partial sums os- 
cillates from 


1 2?" _ 4 2 
a 
3 2?mt1 4 ] 3 
to 
1 27" -— 1 1 
_ > 
3 22m 3 


Comment. Separating the terms of a convergent series by 
clusters of zeros has no effect either on the convergence of the 
series or on its sum. This problem shows that the situation is 
quite different in the case of summation of divergent series. 
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18. Application of Generalized Summation to Multiplication 
of Series 


We now apply the method of generalized summation to the 
problem of multiplication of series (Sec.4). Thus, given two 
series 


ay Qo +a, +s +a, +", (1) 


ims 


Dn 
a=0 


we form the series 


bo + by +o tba toe, (2) 


Y = Y (ab, + a;b,-4 Sie w Qn— 104 + anDo), (3) 
n=0 


2 
i] 
i>} 


.€., the product of (1) and (2) in Cauchy’s form (see p. 15). 
Even if (1) and (2) converge and have ordinary sums A and B, 
the series (3) may fail to converge (see Example 1, p. 27). How- 
ever, we still have the following 

THEOREM. If the series (1) and (2) converge and have ordinary 
sums A and B, then the series (3) is summable by the Poisson— 
Abel method to the generalized sum AB. 

Proof. The series 


Ms 
g 
a 
ca 
a 
| 


= Ag + QyX $s t+ a,x" ql) 
n=O 
and 
Y. bax" = By + Byx +t + Byx™ + + (2’) 
n=0 


both converge absolutely for 0 < x < 1 (Ruds., Lemma, p. 68) to 
sums f(x) and g(x), respectively. Hence the product of (1’) and 
(2’), i.¢., the series 


3 CX" = Y (dob, + Qybg_y + ++ + Gq—yb, + a,b) x" 
n=0 
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also converges for 0 < x < 1 and has the sum f(x) g(x), by the 
classical Cauchy theorem (p. 14). But 
lim f(x) = 4, lim g(x) = B, 
x71- 


x71-— 
by Theorem 1, p. 92, and hence 


lim f(x) g(x) = AB, 


ie., the generalized sum (in the Poisson—Abel sense) of the 
series (3) actually exists and equals AB. I 

The theorem just proved implies Abel’s theorem on the multi- 
plication of series (Theorem 2, p. 29). Moreover, it is clear from 
the proof that the assumption that (1) and (2) converge and have 
ordinary sums A and & can be replaced by the assumption that 
(1) and (2) are summable by the Poisson-Abel method to the 
generalized sums A and B. Recalling Frobenius’ theorem (Theo- 
rem ], p. 101), we conclude that if the series (1), (2) and (3) are 
summable by Cesaro’s method to generalized sums A, B and C, 
respectively, then 

C = AB. 


Example 1. Consider the series 


1 
V2 2°38. 
(2n — 1)(2n — 3) 3-1 


— jy SE 4 
ED QnQn—-2)- 42°” “) 


obtained by setting x = 1 in the binomial expansion 


(2n — 1)(2n — 3)---3-1 
2n (2n — 2)--- 4-2 


x” foie 
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(Ruds., Prob. 3c, p. 123). Multiplying (4) by itself (see Problem 1), 
we get the familiar series 


1-1+4+1—-14+1—-14-:., (5) 


whose generalized sum both in the Poisson—Abel sense and in 
the Cesdro sense equals 


1 L(y 
Ca) 


Example 2. “Squaring” the divergent series (5), we get the 


series 
1-24+3-44+5-—-6+-:, (6) 


which is Poisson—Abel summable to the sum 


but not Cesdro summable! 


PROBLEMS 


1. Prove that 


"(2m — 1) (2m — 3)--3-1 
m= 0 2m (2m — 2)---4-2 


x (2n — 2m — 1)(2n — 2m — 3)---3-1 


=1, 
(2n — 2m) (2n — 2m — 2)---4-2 


where (2m — 1) (2m — 3)---3-1 and 2m (2m — 2)--- 4-2 are 
formally equal to 1 if m = 0. 


2. What is the generalized sum in the Poisson—Abel sense of 
the product of the divergent series (5) and (6)? Write this product. 
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19. Other Methods of Generalized Summation 


We now consider a number of other methods of generalized 
summation, as applied to a given numerical series 


Qi = Ag + Gy ++ +a, +:" (1) 
ie) 


iM =: 


with partial sums 
A,=Ag + Q, +++ + a. 


1) Voronoi’s method. Given a sequence of positive numbers 
{qn}, let 


Q.=4> Q=Gtat:+4n (n > 0), 


and form the expressions 


wo = GQn4g + Gn—-141 +71 + GoAn 
° Q, 


If w, > A asn— oo, then A is called the “generalized sum” o 
the series (1) in the sense of Voronoi, for the given choice of the 
sequence {q,}. The linearity of Voronoi’s method (and of all the 
other methods considered below) is obvious, and need not be 
discussed further. As for the regularity of the method, we have 

THEOREM 1. A necessary and sufficient condition for regularity 
of Voronoi’s method is that 


(n = 0,1, 2,...). 


lim  =0. (2) 
nv Q, 


Proof. First we prove the necessity, assuming that the method 
is regular, i.e., that 4, > A alwaysimplies w, > A. In particular, 
choosing the series 


1-1404040+4-., 
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for which A, = 0 and all other A, = 0 (so that A = 0), we get 


as n — oo, as required. 
To prove the sufficiency, suppose (2) holds. Let 


= Gam 
Qn 


Then ¢,,, ~ 0 as n > o0 (m fixed), since 


™ 


=— Qn—m < Qn-—m > ¢) 


0, On-m 


tn—m 
as n— oo, while 
It follows from Corollary 1, p. 23 that 


lim w, = lim (tpo4o + ta141 +: + toda) = lim A,= A. Hf 
2) The generalized Cesaro method. The method of arithmetic 

means encountered in Sec. 17 is the simplest of an infinite family 

of summation methods due to Cesdro. Given a fixed positive 

integer k, let 

— SR CRE *Ag + Catt Ar to + CEUIAR 


~ nt+k n+k 
Cy k 


(k) 
n 


where as usual C,, is the binomial coefficient 


n n! 


m!(n —m)!- 


Then the limit of y“? asin > oo (provided it exists) is regarded as 
the ‘‘generalized sum” (of order k) of the series (1). For k = 1, 
this reduces to the method of arithmetic means. 
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The generalized Cesaro method is a special kind of regular 
Voronoi method. To see this, we need only set 


7, = cet 
since it follows from the formula 
Che = Chi} + Che. + Ceti te + CHET! (3) 
(see Problem 1) that 
Q,= Cr 
so that 
m@ Cort __k_ iy 
0, Cu* ntk 
asn— oo, 


Using the definition of S“ and the identity (3), we easily find 
that 
SeOY 4 Sed foe p Sikop = sh (4) 
n nmo3 


where S“” = A,. This allows us to prove 
THEOREM 2. Suppose the series 


», a 

n=0 
is summable to A by the generalized Cesadro method of order 
k — 1. Then the series is also summable to A by the generalized 
Cesdro method of order k (and hence of any order >k). 


(k-1) 


Proof. By hypothesis, y, > Aasn— o. But 


sXe _ SiKrD 4 Seov foe Seon 


a+k — nt+k 
k Cy 


(kK) 
ey 


_ Cariye + Ceaayh 0? 4 + CHET ty? 


ntk 
Ck 


because of (4). Using (3) to apply Corollary 1, p. 23, with 
m+k-1 
(k-1) C3 


Xn = ¥n ) fom = On (m = 0, 1,...,n), 


we find that 7° > Aasn—> oo. ff 
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Next we prove the following natural generalization of Frobe- 
nius’ theorem (Theorem 1, p. 101): 
THEOREM 3. Jf the series 


iM. 
= 


is summable by the generalized Cesdro method of any order k toa 
finite “‘sum’’ A, then it is also summable by the Poisson—Abel 
method to the same sum A. 
Proof. By hypothesis, 
(k) 


lim y,? = lim one =A, (5) 
Jo k 


Ao a 
It is easy to see that the power series 


Sx" (6) 
=0 


converges for —1 < x < 1. In fact, since 


k 
nt+k n 
~— 


as n— oo, it follows from (5) that 


(k) 
lim Isnt _ [4 
na nk k! 
If A # 0, then 
lim /|S®| = 1, 


Ao 


so that the radius of convergence of the series (6) equals 1, by the 
Cauchy-Hadamard theorem (Ruds., p. 70), while if A = 0, the 
radius of convergence of (6) is infinite and hence obviously no 
less than 1. 
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Now consider the series of identities 
¥ ax" =(1—x) ¥ Ax = — x) Y SOx, 
n=0 n=O na=0 


Jy Sx = (1— a) FSO (7) 
n=0 n=O 


Sv x= (1— x) Y SOx, 
n=0 n=0 
where we repeatedly make use of formula (4), p. 92 and for- 
mula (4) above. Since the series (6) converges in the interval 
(—1, 1), so do all the other series in (7).8 Combining the identi- 
ties (6), we get 


Y a,x" = d _— x)ktt Y SOx = a _ xyktt y Coty x", 
n=0 n=0 nz0 


(8) 
Moreover, by multiplying the series 
1 a 
= Y x" 
1 — x n=0 
by itself kK + 1 times, we get the identity 
1s (1 — xe? Y Cyt e x, (9) 
n=0 


which holds in the same interval (— 1, 1). Multiplying both sides 
of (9) by A and then subtracting (8) term by term from the result- 
ing identity, we finally obtain 


A- 2, ayx" = a _ xyett x, crt (A _ yi) x", 


8. Cf. the comment to Problem 3, p. 17. 


8 Fichtenholz (2094) 
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The rest of the proof, with the use of (5), is the exact analogue 
of the proofs of Abel’s theorem (Theorem 1, p. 92) and Frobe- 
nius’ theorem (Theorem 1, p. 101). As a result, we conclude that 


lim ) a x"=A. Ef 
x71— n=0 
Remark. There exist divergent series which are summable by 
the Poisson—Abel method, but not by the generalized Cesaro 
method of any order. Thus the Poisson—Abel method is more 
powerful than the generalized Cesaro method of arbitrarily high 
order. 


PROBLEMS 


J. Prove formula (3). 
Hint. Use mathematical induction on n, starting from the 
easily verified formula 


+k —-1)+k n+(k—-1 
Crk = COTE + CEE, 


2. Given any positive integer k, show that the series 


iMs 


(-1 cf" (10) 
0 
is not summable by the generalized Cesaro method of order k, 
but is summable to 1/2*+} by the generalized Cesaro method of 
order k + 1. 
Hint. It follows from (8) and (9) that 


a se” ae 
py 


~ (a — anor 
_ 1 a Cmtky?m 


~ (1 — x2)et! ~ 0 


> ae = y (- 1)" crtkx" 


él anor no 


where the convergence of the last series in the interval (—1, 1) is 
easily proved by using the Cauchy-Hadamard theorem (this 
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implies the convergence of the first series as well). Equating co- 
efficients of identical powers of x in the first and last series,° we 
get 

SR= C8 Sitar. =0 (m=0,1,2,...). CD 


Therefore 
we Hin 1 
ie ane Tamme 
while 


: (k) 
lim yany, = 0, 


so that (10) fails to be summable by the generalized Cesaro 
method of order k. On the other hand, it follows from (3), (4) 
and (11) that 


SetY = ct + K+t + crt? ove Hb crt* = Cote 


both for n = 2m and n = 2m + 1. Hence 


lim y¥*? = lim Ges _ 3 
~ am+k+1  yE41? 
mo ma k+. 2 


and similarly for y#"/?. 


3. Prove that the series 
Y (-)" (a + 1, 
n=0 


where k is any positive integer, is summable by the generalized 
Cesaro method of order k + 1. 


Hint. Expanding C;** in powers of n + 1, we get the formula 


+k 
Cy 


<n + Ryn k— 1)---(@ + 1) 


H 


os (n + IE + af (mn + IETE te + 2 (nt 0), 


9, Here we anticipate the legitimacy of this operation, to be proved in 
G.M.Fichtenholz, Functional Series, Sec.6, Theorem 3. 
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involving certain numerical coefficients «”, where 


] 
ao) = kt # 0. 


Writing similar formulas with k replaced by k ~ 1,k — 2,..., 1, 
and then solving for (n + 1)*, we find that 


(n + 1k = BY Cet + BY Coit! + + BP Cit, 


where the 8“ are again certain numerical coefficients. But then 
Y (-I (nt I = BP Y (- I et + BP Y (—y cett? 
n=0 n=0 n=0 
toe t BOY (-1 cit. 
na=0 


Now use the preceding problem and Theorem 2, as well as the 
linearity of the given method of summation. 


4. By Hélder’s method of generalized summation is meant 
repeated application of the method of arithmetic means. Thus, 
besides 
Xo = Ao, 0, = fot gy a AotdArtt4e 

2 n+1 


as on p. 98, we have next 


, , Bg + ay, , Apta, ter +a, 
ao = &> 4 = ——/ ey “= —_» 
oer 2 n+1 


with corresponding generalized sum 


: , 
lim «,, 
A wna 
then 
” , ” ao + Oy “’ Oo + aL He + OD 
& = 0%, & = ———,..., & = ————————__ .... 


2 n+1 
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with corresponding generalized sum 


. ai 
lim «7, 


now 
and so on. Sum the following series by Hélder’s method: 
aj1—2+3-—4+4-+; b)1-3+6-10+-. 


Ans. a) Twofold “averaging” gives 4; b) threefold ‘taverag- 
ing”’ gives 4. 

Comment. The regularity of Hélder’s method and the relation 
between the various generalized sums can be found by using 
Corollary 2, p. 23. It can be shown that k-fold application of 
the method of arithmetic means is completely equivalent to the 
generalized Cesaro method of order X, i.e., every series summable 
by one method is summable to the same sum by the other 
method. 


20. The Methods of Borel and Euler 


1) Borel’s method. This method consists in forming the ex- 
pression 


tae A, (1) 


involving the partial sums 
A, = Qo + Qy ++ +4, 


of the given numerical series 


> Gn = dg + Ay He +, +. (2) 
n=0 
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Suppose the series in the right-hand side of (1) converges, at 
least for sufficiently large x, and suppose the expression 


ao n 

x 

e* ) A, — 
n=0 n! 


approaches a finite limit A as x > +00. Then the number A is 
called the generalized sum (in the sense of Borel) of the given 
series (2). 

THEOREM. Borel’s method of summation is regular. 

Proof. Suppose the series (2) is convergent, with sum A. Then, 
for sufficiently large x, 


x" 


A-e*) A, et Aa ey Ag 


n=0 n! n=0 n=0 n! 


I 
s 
x 
M 
x 
| 


where «, = A — A,. The right-hand side is the sum of the two 
expressions 
e* ) o&—, e* DY ao, (3) 
n=o— nn! n=N+1 ont 
(here we use the same technique as in the proof of Abel’s theo- 
rem, p.92 and Frobenius’ theorem, p. 101). Given any « > 0, 
let N be so large that |«,| < «for alln > N. Then the second of 
the expressions (3) is less than e in absolute value (independently 
of x), while the first expression, being the product of e~* and a 
polynomial, can be made less than « in absolute value by simply 
choosing x large enough. 
2) Euler’s method. It will be recalled from formula (7), p. 74 


that 
A’ay 


Y(-Dta = y (- S (4) 


(Euler’s transformation). As shown in Sec. 13, if the series on the 
left converges, then the series on the right converges to the same 
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sum. However, the series on the right may converge to a finite 
sum A even if the series on the left diverges. The number A is 
then called the generalized sum (in the sense of Euler) of the series 
on the left. The regularity of this method of summation, known 
as Euler’s method, is an immediate consequence of the italicized 
assertion. 

Starting from the series (4) without the factors of +1 and 
recalling formula (2), p.71 for the pth differences, we see that 
the generalized sum in the sense of Euler of the series (2) is just 
the ordinary sum (provided it exists) of the series 


y @y + Cla; + Cla, +--+ + Cra, 


p=o Qpti 


Remark. This concludes our discussion of methods for sum- 
ming divergent series. We have presented enough material to 
give the reader some idea of the great variety of approaches to the 
problem. Note that we have always insisted that our methods of 
generalized summation be regular. Had space permitted, more 
could have been said aboutthe relations between different meth- 
ods of summation. It may happen that two methods of summa- 
tion have overlapping ‘“‘domains of applicability” (neither of 
which is contained in the other, and it may even turn out that two 
methods assign different “generalized sums” to the same diver- 
gent series. 


PROBLEMS 


1. Sum the series 
1—-1+1-—-1+1—-1l4+- 


by Borel’s method. 
Ans. 
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2. Sum the following series by Euler’s method: 
al—-i+i-i¢+-; bl—-24+3-44:-5; 
c)1—2+4+2?-—234+--; dl} — 234 33-44 4--. 
Hint. In each case, use formula (4). 


Ans. a)A=4; b)4°a,=1,4!a,=1,A"ag =0 if p>, 


A=4-4=4; c)4’a,=1,4=4-3+4---=4; 
d) A°ay = 1, A'ag = 7, A2aq = 12, A3ag = 6, A¥a, = 0 
if p>3,4-4-14+3-S = -4. 

3. Let 


Po(x), g(x), very D (x), wee 


be a sequence of functions defined on a domain X, where X has 
a (finite or positively infinite) limit point w. Given a numerical se- 
ries (2), with partial sums A, = do + a, + -+- + a,, construct 
the ‘functional series” 


», An (x) = AoPo (x) + AQ (x) top APn (x) to, 
(5) 


Suppose the series (5) converges, at least for x sufficiently near w, 
and suppose the sum of (5) approaches a finite limit A as x > w. 
Finally, let A be called the ‘‘generalized sum”’ of the series (2). 
This gives a very general method of summation, which is ob- 
viously linear. Prove that the method is also regular, provided 
the functions @,(x) satisfy the following three conditions: 


1) For every fixed n, 


lim @,(x) = 0; 


x70 
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2) For x close enough to w (i.e., for |x — w| < dif is finite 
orx >Aifw = +o), 
Y Iea(%)| < K = const; 
3) n=0 
lim y y,(x) = 1. 


x7a@ m-+0 


Hint. If A, + Aasn— o, then, given anye > 0, thereisan N 
so large that 


|A, — Al < z (6) 


for alln > N. It follows from the boundedness of the A, and the 
absolute convergence of the series 


» Pa(X) 


that the series 
ao 
Y AnPa(x) 
n=Q 
converges (at least for x close enough to w). Moreover, 


Yi Arte) — A= Y Ap AAG) + Y= A) 


+a(y A(x) — '), 


and hence 
N 


Y (4, — 4) g(x) 


n=0 


Y Apa(x) — A < 


+ ¥ |A, — Al |pa(x)| + [Al 
m=N4+1 


2, P(X) — 1 . 


The second term on the right is less than ¢ because of (6), while 
the first and third terms can each be made less than « by choos- 
ing x close enough to w. 
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Comment. Clearly, there is another version of the foregoing 
which involves the numbers a, (the terms of the series) rather 
than the partial sums A,. 


4. Particularize the preceding problem to the case where X is 
the set of all nonnegative integers m, with limit point @ = +0. 

Hint. Instead of the sequence of functions {y,(x)}, we now 
have an infinite rectangular matrix 


(7) 


(tam = Pa(m)), and the “generalized sum” of the series (2) be- 
comes 


lim (Aofom + Aitim + Aatom +++ + Antam + °°). 


Ma 


The regularity conditions are now the following: 
1) For every fixed n, 


lim ti, = 0; 


m0 


2) For sufficiently large m, 


> Ital < K = const; 
n=0 
3) 
lim } tan = 1. 


moc n=0 
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Comment. These ideas are essentially due to Toeplitz, who, 
however, considered the case where the matrix (7) reduces to an 
infinite triangular matrix. This special case is sufficient for most 
purposes. 


J. Show that the general method of summation of Problem 3 
contains the Poisson-~Abel method and the Borel method as 
special cases. 

Ans. The Poisson-Abel method corresponds to 


g(x) =(1- Xx, X=(00,1), o=1, 


while the Borel method corresponds to 
x" 
(xX) = ex, X=(0,+0), w= +0 
n! 


(the regularity conditions are clearly satisfied in both cases). 
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